Web server testing

[migrantgeek]

Hi all,

I've been searching around for some of the best ways to test web servers
and most articles I read are old.

Can someone describe what methods / software they use to load test their
web servers? I'm looking for software that could also crawl a page to
discover more links on the site as opposed to just the main page.

Thanks,

Seth

Posted at Nginx Forum: http://forum.nginx.org/read.php?2,115548,115548#msg-115548