High memory consumption when proxying to a Comet server

[Maxim Dounin]

Hello!

On Mon, Jun 07, 2010 at 11:15:20PM -0300, Rogério Schneider wrote:

> On Fri, May 28, 2010 at 10:54 AM, zanettea <nginx-forum at nginx.us> wrote:
> > I have the very same problem trying to proxying a MJPEG stream. I really would appreciate a solution not involving periodically resetting the connection.
> 
> I have seen your post referring mine, here
> http://forum.nginx.org/read.php?29,91967,92454 and also have seen this
> another post related to the matter here
> http://forum.nginx.org/read.php?2,84623,84623#msg-84623 but no one
> seems to bother in giving a direct response if that is or isn't
> possible to free memory for chunked responses BEFORE the connection
> ends.

No, small allocations can't be freed in nginx.  I outlined correct 
fix as soon as the problem was identified, here:

http://nginx.org/pipermail/nginx/2010-April/019845.html

One should sit and code buffers reuse in chunked module.  I have 
this in my TODO list, but didn't done this yet due to ENOTIME.

Maxim Dounin