nginx internals: processors versus network

[James Read]

Hi,

I have a question about nginx internals. How does nginx ensure high
throughput? I understand that nginx uses many parallel connections by using
epoll. But what about processors? Is connection handling spread amongst
multiple processors to handle any processing bottleneck?

The reason I ask is because I am building a web crawler using libev and
libcurl and my aim is to match nginx capability for throughput. I made a
web crawler that can handle 10,000+ connections but throughput is not
impressive. ~16Mbps on average. It was suggested to me on stackoverflow
that this could be because of a processor bottleneck. Does nginx suffer
from similar limitations?

James Read
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.nginx.org/pipermail/nginx/attachments/20201201/736e52f8/attachment.htm>