The request buffer in Nginx Http FcgiModule

[Rob Schultz]

On Mar 19, 2010, at 9:19 AM, li zJay <zjay1987 at gmail.com> wrote:

> If the the raw upload file is to be saved in the local server, Nginx
> has good performance.
> But I want to compress the upload file and split it and then transfer
> to another central storage system,
> the file is not to be stored locally.
>
> In fact, the problem is that, if there's 1000 concurrent requests,
> each request has 500MB post body,
> It's to comsume 500G temporary disk space, and it will take a lot of
> time to process these data too.
>
> So, I think that if there's stream processing support, It will be
> better under this application.

There is a mogilefs module http://wiki.nginx.org/Nginx3rdPartyModules#Mogilefs_Module 
  also you can turn proxy buffering off if you can implement http on  
the backend instead of wsgi or fastcgi.

V/r,
Rob Schultz