Image Hosting

[Maxime Ducharme]

Hi

Thread is quite old for reply but maybe this will help

our setup :
- we set blockdev of RAID devices to 4096
- RAID stripe to 256K
- scheduler must be set to "deadline" (on Linux
see /sys/block/sda/queue/scheduler)
- xfs used here with these options : noatime,nobarrier
- worker_processes should be equals your number of cores, we have 16
- disable logging
-    sendfile_max_chunk  512k;
-    sendfile off;
-    tcp_nopush     on;
-    tcp_nodelay on;
-    output_buffers 1 1m;
-    keepalive_timeout  0;

With this setup we can do 1.7 GBits/s traffic. We are serving bigger
files so these wont be ideal for your situation but may be helpful. We
have 28TB of data per server.

FYI we do 350 mbytes/s on Treeware/Adaptec SATA RAID. You may try bonnie
++ on this box to see how it can do on plain disk access.

have a nice day

-- 
Maxime Ducharme
Systems Architect
Techboom Inc


On Thu, 2010-10-14 at 22:41 -0700, Indo Php wrote:
> This server is already using ext4 filesystem
> 
> 
> ______________________________________________________________________
> From: Splitice <mat999 at gmail.com>
> To: "nginx at nginx.org" <nginx at nginx.org>
> Sent: Fri, October 15, 2010 12:24:14 PM
> Subject: Re: Image Hosting
> 
> I've heard great things about ext4 and xfs.
> 
> Sent from my iPod
> 
> On 15/10/2010, at 12:11 PM, iptablez at yahoo.com wrote:
> 
> > What a great result. Could you please be kind to share your
> configuration?
> > 
> > 
> > -----Original Message-----
> > From: Piotr Karbowski <jabberuser at gmail.com>
> > Date: Thu, 14 Oct 2010 19:38:56 
> > To: <nginx at nginx.org>
> > Reply-To: nginx at nginx.org
> > Subject: Re: Image Hosting
> > 
> > On 10/14/2010 09:36 AM, Indo Php wrote:
> >> hi there,
> >> 
> >> we have an image hosting, and of course we're using Nginx!
> >> 
> >> Now on we're having problem with disk i/o. With 200GB of images.
> >> Is there any recommendation for this matter? Nginx configuration or
> >> Hardware/other software configuration?
> >> 
> >> We already used Dual Quad Core 3Ghz, 8 GB RAM, 6x73GB 15k SCSI
> server
> > 
> > Hi there,
> > 
> > I have something kinda image hosting, almost 220G (651k files,
> images).
> > Since most users getting quite random content, there is no way
> cache 
> > most used files in ram.
> > 
> > We got best performances with ext4 and bfq io sched, Whole system
> is 
> > gentoo-based etc... so I think you may want try optimize it on OS
> level.
> > 
> > Dual Core Xeon 2,5GHz, 4G ram and standalone raid10 array, two
> nginx 
> > workers.
> > 
> > -- Piotr.
> > 
> > _______________________________________________
> > nginx mailing list
> > nginx at nginx.org
> > http://nginx.org/mailman/listinfo/nginx
> > _______________________________________________
> > nginx mailing list
> > nginx at nginx.org
> > http://nginx.org/mailman/listinfo/nginx
> 
> _______________________________________________
> nginx mailing list
> nginx at nginx.org
> http://nginx.org/mailman/listinfo/nginx
> 
> 
> 
> _______________________________________________
> nginx mailing list
> nginx at nginx.org
> http://nginx.org/mailman/listinfo/nginx