Tuning workers and connections

[hagai avrahami]

Hi

3,9 and 27 seconds sounds like tcp retransmission timeouts
http://my.opera.com/cstrep/blog/2011/07/23/how-to-detect-tcp-retransmit-timeouts-in-your-network

It sounds like the tcp listen backlog queue is too small and 
syn packets incoming from the client are dropped

You can set max for all TCP sockets by configuring sysctl file
net.ipv4.tcp_max_syn_backlog = 10000

And to add to Nginx configuration  (Nginx default value is 511)


listen  80  default  backlog=10000;
I hope it helps.

Hagai Avrahami


I hope it helps.










>________________________________
> From: liangrubo <nginx-forum at nginx.us>
>To: nginx at nginx.org 
>Sent: Tuesday, August 21, 2012 10:23 AM
>Subject: Re: Tuning workers and connections
> 
>Hello, we meet similar problem.
>
>if we set "multi_accept off;" and "accept_mutex on;", it sometimes took 3 or
>9 or even 21 seconds to connect to nginx on port 80 from the same server. if
>we set "multi_accept on;" and "accept_mutex off;",  we can connect to nginx
>on port 80 instantly but it may take long to get the response (more than 3
>seconds for small css files on the same server).
>
>Our deploy structure is as follows:
>frontend nginx listen on port 80, servering static files. For dynamic
>requests, nginx on port 80 reverse proxy to nginx on port 81 via tcp socket,
>nginx on port 81 again reverse proxy to uwsgi via unix sokcet.
>
>the site is handling about 1200 requests per second.
>
>the server has 24 cpu cores and 96G memory.  the system has low load, lots
>of free memory and no IO bottleneck.
>
>some of the nginx configurations are as follows:
>worker_processes 8; //it was originally 4, I doubled it but it didn't help
>worker_rlimit_nofile 15240;
>worker_connections  15240;
>
>use epoll;
>
>we have keepalive setup for upstream(80 to 81 reverse proxy) as follows:
>keepalive 32;
>
>
>information shown by status_sub:
>Active connections: 4320 
>server accepts handled requests
>9012300 9012300 37349248 
>Reading: 118 Writing: 199 Waiting: 4003 
>
>we examined the dynamic request handling is fast and even if it was slow, it
>should not affect static file servering on port 80 anyway, right?
>
>it seems nginx can't process the request fast enough but we can't find what
>is the bottleneck.
>
>any help is greatly appreciated.
>
>Posted at Nginx Forum: http://forum.nginx.org/read.php?2,3638,229939#msg-229939
>
>_______________________________________________
>nginx mailing list
>nginx at nginx.org
>http://mailman.nginx.org/mailman/listinfo/nginx
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.nginx.org/pipermail/nginx/attachments/20120826/7cfc507e/attachment.html>