Using proxy_store under heavy load.
is at rambler-co.ru
Wed May 20 21:52:17 MSD 2009
On Wed, May 20, 2009 at 07:48:27PM +0300, zepolen wrote:
> I'm using proxy_store to act as a frontend mirror/cache to amazon s3 for my
> sites photos.
> Response times are slow, iotop reports ~10-15MB/s being written to disk by
> The website implements a 'latest' feature, any new photos will requested by
> many users at the same time.
> I'm thinking nginx is probably getting a request for a photo it doesn't
> already have, and while it is retrieving the file from s3, more requests
> come in for the same file, meaning more round trips and more temp files
> being created.
> Does proxy_cache handle it differently? (ie, does it know that a url is
> currently being retrieved from the backed, and block other requests for that
> url until the file has been retrieved)
No, proxy_cache does the same.
More information about the nginx