Nginx worker processors D state and high I/O utilization !!
shahzaib shahzaib
shahzaib.cb at gmail.com
Tue Jul 16 05:25:19 UTC 2013
Yes we're using raid-10.
On Tue, Jul 16, 2013 at 10:17 AM, Steve Holdoway <steve at greengecko.co.nz>wrote:
> How are you using them?? Raid 10?
>
> On the offchance, is
>
> http://www.greengecko.co.nz/content/western-digital-can-i-have-my-2-days-back
> relevant?
>
> Cheers,
>
> Steve
>
> On Tue, 2013-07-16 at 10:10 +0500, shahzaib shahzaib wrote:
> > We're using 4XSata HDD 7200 rpm and yes it is hardly crossing
> > 20MB/sec. Could you please guide me a bit about the Max speed of SATA
> > read?
> >
> >
> > Thanks for prompt reply.
> >
> >
> >
> > On Tue, Jul 16, 2013 at 10:06 AM, Steve Holdoway
> > <steve at greengecko.co.nz> wrote:
> > Your disk maxes out at 20MB/sec read?
> >
> > On Tue, 2013-07-16 at 09:59 +0500, shahzaib shahzaib wrote:
> > > Hello,
> > >
> > >
> > > We're using nginx-1.2.8 to serve large static files
> > for video
> > > streaming. However all nginx worker_processes are in "D"
> > state and HDD
> > > I/O utilization is 99%.
> > >
> > > [root at DNTX010 ~]# ps aux |grep nginx
> > > root 3046 0.0 0.0 20272 688 ? Ss 20:39
> > 0:00
> > > nginx: master process nginx
> > > nginx 3047 3.2 0.9 94480 74808 ? D 20:39
> > 0:03
> > > nginx: worker process
> > > nginx 3048 1.4 0.3 52104 31388 ? D 20:39
> > 0:01
> > > nginx: worker process
> > > nginx 3049 0.2 0.1 33156 12156 ? S 20:39
> > 0:00
> > > nginx: worker process
> > > nginx 3050 0.1 0.1 29968 8844 ? D 20:39
> > 0:00
> > > nginx: worker process
> > > nginx 3051 0.2 0.1 30332 10076 ? D 20:39
> > 0:00
> > > nginx: worker process
> > > nginx 3052 2.7 0.8 91788 69504 ? D 20:39
> > 0:02
> > > nginx: worker process
> > > nginx 3053 0.3 0.0 25632 5384 ? D 20:39
> > 0:00
> > > nginx: worker process
> > > nginx 3054 0.2 0.1 36032 15852 ? D 20:39
> > 0:00
> > > nginx: worker process
> > > nginx 3055 0.4 0.2 37592 17396 ? D 20:39
> > 0:00
> > > nginx: worker process
> > > nginx 3056 0.2 0.1 32580 11028 ? S 20:39
> > 0:00
> > > nginx: worker process
> > > nginx 3057 0.3 0.2 39288 19116 ? D 20:39
> > 0:00
> > > nginx: worker process
> > > nginx 3058 0.3 0.2 41764 19744 ? D 20:39
> > 0:00
> > > nginx: worker process
> > > nginx 3059 0.3 0.1 31124 10480 ? D 20:39
> > 0:00
> > > nginx: worker process
> > > nginx 3060 1.0 0.3 52736 31776 ? D 20:39
> > 0:01
> > > nginx: worker process
> > > nginx 3061 1.1 0.3 51920 29956 ? D 20:39
> > 0:01
> > > nginx: worker process
> > > nginx 3062 1.6 0.4 58808 35548 ? D 20:39
> > 0:01
> > > nginx: worker process
> > >
> > >
> > > [root at DNTX010 ~]# iostat -x -d 3
> > > Linux 2.6.32-358.6.2.el6.x86_64 (DNTX010.local)
> > 07/16/2013
> > > _x86_64_ (8 CPU)
> > >
> > > Device: rrqm/s wrqm/s r/s w/s rsec/s
> > wsec/s
> > > avgrq-sz avgqu-sz await svctm %util
> > > sda 30.28 177.37 260.32 2.96 38169.26
> > 1442.70
> > > 150.46 2.29 8.70 3.52 92.78
> > >
> > > Device: rrqm/s wrqm/s r/s w/s rsec/s
> > wsec/s
> > > avgrq-sz avgqu-sz await svctm %util
> > > sda 4.33 0.00 544.00 0.00 34376.00
> > 0.00
> > > 63.19 43.83 75.25 1.84 100.00
> > >
> > > Device: rrqm/s wrqm/s r/s w/s rsec/s
> > wsec/s
> > > avgrq-sz avgqu-sz await svctm %util
> > > sda 9.00 6.33 547.67 0.67 34637.33
> > 56.00
> > > 63.27 48.01 86.20 1.82 100.00
> > >
> > > Device: rrqm/s wrqm/s r/s w/s rsec/s
> > wsec/s
> > > avgrq-sz avgqu-sz await svctm %util
> > > sda 0.00 0.67 568.00 2.33 36024.00
> > 29.33
> > > 63.21 54.98 101.10 1.75 100.00
> > >
> > > Device: rrqm/s wrqm/s r/s w/s rsec/s
> > wsec/s
> > > avgrq-sz avgqu-sz await svctm %util
> > > sda 0.00 4.33 560.33 1.33 35712.00
> > 45.33
> > > 63.66 37.20 65.06 1.78 100.00
> > >
> > >
> > >
> > > Nginx.conf :
> > >
> > > http {
> > > include mime.types;
> > > default_type application/octet-stream;
> > > client_body_buffer_size 128K;
> > > sendfile_max_chunk 128k;
> > > client_max_body_size 800m;
> > > client_header_buffer_size 256k;
> > > large_client_header_buffers 4 256k;
> > > output_buffers 1 512k;
> > > server_tokens off; #Conceals nginx version
> > > #access_log logs/access.log main;
> > > access_log off;
> > > error_log warn;
> > > sendfile on;
> > >
> > > # aio on;
> > >
> > > # directio 512k;
> > >
> > > ignore_invalid_headers on;
> > > client_header_timeout 3m;
> > > client_body_timeout 3m;
> > > send_timeout 3m;
> > > keepalive_timeout 0;
> > > reset_timedout_connection on;
> > > }
> > >
> > >
> > > We've also tried enabling aio directive but nothing changed.
> > Help will
> > > be highly appreciated.
> > >
> > >
> > > Thanks
> > > Shahzaib
> > >
> > >
> >
> > > _______________________________________________
> > > nginx mailing list
> > > nginx at nginx.org
> > > http://mailman.nginx.org/mailman/listinfo/nginx
> >
> > --
> > Steve Holdoway BSc(Hons) MNZCS
> > http://www.greengecko.co.nz
> > Linkedin: http://www.linkedin.com/in/steveholdoway
> > Skype: sholdowa
> >
> > _______________________________________________
> > nginx mailing list
> > nginx at nginx.org
> > http://mailman.nginx.org/mailman/listinfo/nginx
> >
> >
> > _______________________________________________
> > nginx mailing list
> > nginx at nginx.org
> > http://mailman.nginx.org/mailman/listinfo/nginx
>
> --
> Steve Holdoway BSc(Hons) MNZCS
> http://www.greengecko.co.nz
> Linkedin: http://www.linkedin.com/in/steveholdoway
> Skype: sholdowa
>
> _______________________________________________
> nginx mailing list
> nginx at nginx.org
> http://mailman.nginx.org/mailman/listinfo/nginx
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.nginx.org/pipermail/nginx/attachments/20130716/945d7f4c/attachment.html>
More information about the nginx
mailing list