Using proxy_store under heavy load.
dave at cheney.net
Wed May 27 05:23:57 MSD 2009
I suspect that the worker is spending a lot of time in the write() to the
disk of the cached file. How many workers are your running ?
> « HTML content follows »
> I'm using proxy_store to act as a frontend mirror/cache to amazon s3 for
> my sites photos.
> Response times are slow, iotop reports ~10-15MB/s being written to disk by
> The website implements a 'latest' feature, any new photos will requested
> by many users at the same time.
> I'm thinking nginx is probably getting a request for a photo it doesn't
> already have, and while it is retrieving the file from s3, more requests
> come in for the same file, meaning more round trips and more temp files
> being created.
> Does proxy_cache handle it differently? (ie, does it know that a url is
> currently being retrieved from the backed, and block other requests for
> that url until the file has been retrieved)
More information about the nginx