How to log GoogleBot useragent in its own access log?

David Taveras d3taveras38d3 at gmail.com
Thu Mar 4 01:12:15 MSK 2010


Hello..

Would it be possible to match if the useragent contains this string
"+http://www.googlebot.com/bot.html"  and log it in a specific file
for googles crawling?

I know that anybody can forge that.. but its still very useful to us.

Thanks

David



More information about the nginx mailing list