How to block fake google spider and fake web browser access?

meteor8488 nginx-forum at nginx.us
Tue May 5 13:07:41 UTC 2015


It seems that I can't edit my post. I have to post my question here:
 I tried to use "deny" to deny access from an IP. But it seems that it can
still access my server.

In my http part:

deny  69.85.92.0/23;
deny  69.85.93.235;

But when I check the log, I still can find

 69.85.93.235 - - [05/May/2015:19:44:22 +0800] "GET /thread-1251687-1-1.html
HTTP/1.0" 302 154 "http://www.example.com" "Mozilla/5.0 (compatible;
Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
"123.125.71.107"
    69.85.93.235 - - [05/May/2015:19:50:06 +0800] "GET
/thread-1072432-1-1.html HTTP/1.0" 302 154 "http://www.example.com"
"Mozilla/5.0 (compatible; Baiduspider/2.0;
+http://www.baidu.com/search/spider.html)" "220.181.108.151"


it seems deny is not working.

Any one can help?

Posted at Nginx Forum: http://forum.nginx.org/read.php?2,258659,258660#msg-258660



More information about the nginx mailing list