Stoping bots and wget in nginx

Igor Sysoev is at rambler-co.ru
Thu Dec 20 20:41:26 MSK 2007


On Thu, Dec 20, 2007 at 11:26:29AM -0600, Alexis Torres Garnica wrote:

> 
>    Hi guys and tnks for your answer, I added the robots.txt to my
>    /home/htdocs =) tnks. I have this rewrite rules:
>            if ($http_user_agent = "Wget/*") {

-            if ($http_user_agent = "Wget/*") {
+            if ($http_user_agent ~ "Wget/|Teleport Pro|WebCopier") {

>                    return 403;
>            }
>            if ($http_user_agent = "Teleport Pro") {
>                    return 403;
>            }
>            if ($http_user_agent = "WebCopier") {
>                    return 403;
>            }
>    I do a simple test with wget but I can download files with it, I tryed
>    with wget, Wget, Wget* and the last Wget/* but its not working.


-- 
Igor Sysoev
http://sysoev.ru/en/





More information about the nginx mailing list