nginx internals: processors versus network

[Reinis Rozitis]

> I have a question about nginx internals. How does nginx ensure high throughput? I understand that nginx uses many parallel connections by using epoll. But what about processors? Is connection handling spread amongst multiple processors to handle any processing bottleneck?

If necessary you can assign workers to particular cores: http://nginx.org/en/docs/ngx_core_module.html#worker_cpu_affinity


> I made a web crawler that can handle 10,000+ connections but throughput is not impressive. ~16Mbps on average.

You have to elaborate on how nginx actually works as a crawler? Some module? Lua code?

rr