The request buffer in Nginx Http FcgiModule
rschultz7 at gmail.com
Fri Mar 19 20:37:59 MSK 2010
On Mar 19, 2010, at 9:19 AM, li zJay <zjay1987 at gmail.com> wrote:
> If the the raw upload file is to be saved in the local server, Nginx
> has good performance.
> But I want to compress the upload file and split it and then transfer
> to another central storage system,
> the file is not to be stored locally.
> In fact, the problem is that, if there's 1000 concurrent requests,
> each request has 500MB post body,
> It's to comsume 500G temporary disk space, and it will take a lot of
> time to process these data too.
> So, I think that if there's stream processing support, It will be
> better under this application.
There is a mogilefs module http://wiki.nginx.org/Nginx3rdPartyModules#Mogilefs_Module
also you can turn proxy buffering off if you can implement http on
the backend instead of wsgi or fastcgi.
More information about the nginx