block robots for some urls

toto2008 nginx-forum at nginx.us
Mon Jul 19 01:34:12 MSD 2010


Hello,

Why not using a robots.txt file ? http://www.robotstxt.org/

Posted at Nginx Forum: http://forum.nginx.org/read.php?2,108971,110262#msg-110262




More information about the nginx mailing list