Hi Need help with Throttle Limit.

[thehuntersays .]

Hi,

I use Nginx as front end Engine for handling huge Traffic, we receive
around 30k qps and have kept 5 Nginx under ELB (Elastic Load Balancer),
each handling 6 k qps.

I am using the Nginx Upstream module for connecting with the backend
server, my Backend server is able to handle only 300qps, we use Nginx for
mainly for throttling the request.

But to my surprise on increasing the throttling limit to more than 100 qps,
then Nginx is able to handle only around 1000, with throttling rate set to
1500qps, its able to handle only 250.

The following is the configuration i am using.

worker_processes  auto;

events {
    use epoll;
    multi_accept on;
    worker_connections  9046;
}

http {

    log_format  main  '$remote_addr - $remote_user [$time_local] "$request"
'
                      '$status $body_bytes_sent "$http_referer" '
                      '"$http_user_agent" "$http_x_forwarded_for"';

    access_log          off;
    error_log             /dev/null   crit;

    sendfile       on;
    tcp_nopush     on;

    keepalive_timeout  0

*  limit_req_zone $binary_remote_addr zone=jai:100m rate=1500r/s;*

*    upstream backend*
*    {*
*            server 127.0.0.1:5555 <http://127.0.0.1:5555>;*
*    }*

    server {
        listen       80 backlog=16384;
        server_name  localhost;

        location /jai {

                keepalive_timeout  60;
                keepalive_requests 10000;

*                proxy_pass http://backend <http://backend>;*
*                proxy_set_header Connection "keep-alive";*
*                limit_req zone=jai burst=1000 nodelay;*

                access_log logs/dsp-access.log  main buffer=32k;
                error_log logs/dsp-error.log crit;
        }

Please let me know how to make Nginx handle more request with throttle
enable with the backend servers.

Thanks in advance,

Jaysingh Samuel
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.nginx.org/pipermail/nginx-devel/attachments/20140310/2ce38bbc/attachment.html>