Using proxy_store under heavy load.

[Dave Cheney]

I suspect that the worker is spending a lot of time in the write() to the 
disk of the cached file. How many workers are your running ? 

Cheers

Dave

zepolen writes:

> « HTML content follows »
> 
> I'm using proxy_store to act as a frontend mirror/cache to amazon s3 for 
> my sites photos.
> 
> Response times are slow, iotop reports ~10-15MB/s being written to disk by 
> nginx.
> 
> The website implements a 'latest' feature, any new photos will requested 
> by many users at the same time.
> 
> I'm thinking nginx is probably getting a request for a photo it doesn't 
> already have, and while it is retrieving the file from s3, more requests 
> come in for the same file, meaning more round trips and more temp files 
> being created. 
> 
> Does proxy_cache handle it differently? (ie, does it know that a url is 
> currently being retrieved from the backed, and block other requests for 
> that url until the file has been retrieved)