Image Hosting

Indo Php iptablez at yahoo.com
Thu Oct 14 18:26:08 MSD 2010


Here's the output of "iostat -d 60 2"
Device:            tps   Blk_read/s   Blk_wrtn/s   Blk_read   Blk_wrtn
sda              85.58      4947.94      2619.30  593632866  314252346

Device:            tps   Blk_read/s   Blk_wrtn/s   Blk_read   Blk_wrtn
sda             114.41      8395.93       339.01     503840      20344

here's the output of vmstat
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 0  1    332  63136 628344 6085040    0    0   617   324   17   27  1  4 88  6




________________________________
From: Dennis Jacobfeuerborn <dennisml at conversis.de>
To: nginx at nginx.org
Sent: Thu, October 14, 2010 7:54:26 PM
Subject: Re: Image Hosting

Ah, sorry I somehow didn't catch that last line with the actual HW setup.

If my math skills don't fail me (and they very well might) the traffic and 
image size data mean that you serve about 300 images per second.
Can you post a few lines of vmstat output and perhaps the output of "iostat 
-d 60 2"?

Also how are the hits distributed across the whole pool of images? Are 
these hits truly random or are some images hit significantly more often 
than others?

More ram would obviously take some pressure off the disks if they are 
really the problem.

Regards,
   Dennis

On 10/14/2010 02:26 PM, iptablez at yahoo.com wrote:
> Actually the image size is arround 100KB each. The server is running in 250Mbps 
>traffic.
> I already described the disk I'm using is scsi 15K RPM in raid 0
>
>
> Sent from my BlackBerry®
> powered by Sinyal Kuat INDOSAT
>
> -----Original Message-----
> From: Dennis Jacobfeuerborn<dennisml at conversis.de>
> Date: Thu, 14 Oct 2010 14:23:26
> To:<nginx at nginx.org>
> Reply-To: nginx at nginx.org
> Subject: Re: Image Hosting
>
> But if those 5,000 req/s each hit a different 1mb image then you need to
> read 5gb of data from you storage which if your storage is just a plain old
> sata disk is going to be a huge problem.
>
> Unfortunately Indo Php is not providing nearly enough information to give
> any sort of advice. If he is lucky then putting lots of ram in the machine
> for pagecache can help here if the cache hit ratio is good but if it is not
> then he probably has to distribute the I/O across more spindles and go for
> a raid with lots of disks.
>
> Regards,
>     Dennis
>
> On 10/14/2010 10:33 AM, SplitIce wrote:
>> Hmm well talking from experience nginx can serve upwards of 5,000 req/s for
>> static files if configured right. Ill leave this for Igor or someone more
>> expericed to reply to.
>>
>> On Thu, Oct 14, 2010 at 7:28 PM, Indo Php<iptablez at yahoo.com
>> <mailto:iptablez at yahoo.com>>  wrote:
>>
>>      i tried to use AIO, but it seems my server is getting slower
>>
>>      
>>---------------------------------------------------------------------------
>>      *From:* SplitIce<mat999 at gmail.com<mailto:mat999 at gmail.com>>
>>      *To:* nginx at nginx.org<mailto:nginx at nginx.org>
>>      *Sent:* Thu, October 14, 2010 2:47:55 PM
>>      *Subject:* Re: Image Hosting
>>
>>      Try any of these:
>>      1) Compile nginx with AIO support
>>      2) Try directio option
>>      3) Try sendfile option
>>
>>      On Thu, Oct 14, 2010 at 6:36 PM, Indo Php<iptablez at yahoo.com
>>      <mailto:iptablez at yahoo.com>>  wrote:
>>
>>          hi there,
>>
>>          we have an image hosting, and of course we're using Nginx!
>>
>>          Now on we're having problem with disk i/o. With 200GB of images.
>>          Is there any recommendation for this matter? Nginx configuration or
>>          Hardware/other software configuration?
>>
>>          We already used Dual Quad Core 3Ghz, 8 GB RAM, 6x73GB 15k SCSI 
server
>>
>>
>>
>>
>>          _______________________________________________
>>          nginx mailing list
>>          nginx at nginx.org<mailto:nginx at nginx.org>
>>          http://nginx.org/mailman/listinfo/nginx
>>
>>
>>
>>
>>      _______________________________________________
>>      nginx mailing list
>>      nginx at nginx.org<mailto:nginx at nginx.org>
>>      http://nginx.org/mailman/listinfo/nginx
>>
>>
>>
>>
>> --
>> Warez Scene<http://thewarezscene.org>  Free Rapidshare Downloads
>> <http://www.nexusddl.com>
>>
>>
>>
>> _______________________________________________
>> nginx mailing list
>> nginx at nginx.org
>> http://nginx.org/mailman/listinfo/nginx
>
>
> _______________________________________________
> nginx mailing list
> nginx at nginx.org
> http://nginx.org/mailman/listinfo/nginx
> _______________________________________________
> nginx mailing list
> nginx at nginx.org
> http://nginx.org/mailman/listinfo/nginx


_______________________________________________
nginx mailing list
nginx at nginx.org
http://nginx.org/mailman/listinfo/nginx



      
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://nginx.org/pipermail/nginx/attachments/20101014/ba7fda44/attachment.html>


More information about the nginx mailing list