Two type of rate limiting for based on IP address

Quintin Par quintinpar at gmail.com
Mon Mar 12 04:17:18 UTC 2012


Hi all,

 How can I maintain two rate limit strategies?One for spiders and one for
regular users?

I can get the IP address list of spiders from

http://www.iplists.com/ . Can I separate it by geo? Have people attempted
this?

My website is being pounded by some screen scrapers and I want to block
them, but not at the risk of blocking search engine spiders.

-Quintin
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.nginx.org/pipermail/nginx/attachments/20120312/6d61ecb3/attachment.html>


More information about the nginx mailing list