nginx Digest, Vol 55, Issue 26
plasmaracer .
pacr.zeolite at gmail.com
Sat May 10 20:31:02 UTC 2014
On May 10, 2014 6:00 AM, <nginx-request at nginx.org> wrote:
> Send nginx mailing list submissions to
> nginx at nginx.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
> http://mailman.nginx.org/mailman/listinfo/nginx
> or, via email, send a message with subject or body 'help' to
> nginx-request at nginx.org
>
> You can reach the person managing the list at
> nginx-owner at nginx.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of nginx digest..."
>
>
> Today's Topics:
>
> 1. Re: Caching servers in Local ISPs !! (itpp2012)
> 2. Re: subs filter error (Jonathan Matthews)
> 3. Re: Caching servers in Local ISPs !! (Steve Holdoway)
> 4. Re: Caching servers in Local ISPs !! (shahzaib shahzaib)
> 5. Re: subs filter error (Tom McLoughlin)
> 6. Re: Caching servers in Local ISPs !! (itpp2012)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Fri, 09 May 2014 16:01:46 -0400
> From: "itpp2012" <nginx-forum at nginx.us>
> To: nginx at nginx.org
> Subject: Re: Caching servers in Local ISPs !!
> Message-ID:
> <
> c081cd6fb43e5b579a74dcda519cecf6.NginxMailingListEnglish at forum.nginx.org>
>
> Content-Type: text/plain; charset=UTF-8
>
> > So on easy note, i would have to assign those machines the preferred
> > dns
> > and use rsync on regular basis in order to make identical data
> > between
> > local caching machines and main front end content servers ?
>
> Yep.
>
> > What if a client request a video which is not in local caching server
> > ?
>
> You need to maintain a cache index on each cache machine in order to
> determine what is available to the users, for most content you need to do
> this anyway since not all content can legally be everywhere and you also
> might want to customize what you present for each region.
>
> > Does nginx has the configuration for it to check the files locally and
> > then
> > forward the request to main content servers if requested file is not
> > cached
> > locally ?
>
> There are many ways to do this with nginx and Lua but a independent cache
> index would be much better, with it you can do much more like redirect a
> content source from elsewhere depending on load and demand. You simply feed
> nginx the cache index. A very simplistic cache index system is abusing a
> local (local to nginx) dns server, assign local IP's to resources and
> change
> them according to load and demand. Again for a local DNS you can assign
> whatever you want to a dns name, with a local ttl of 15 seconds and nginx
> loadbalancing between 4 regional resources it will be peanuts to change the
> load based on demand (provided you have monitoring in place which can act
> on
> such data). Basically a DIY BGP :)
>
> Posted at Nginx Forum:
> http://forum.nginx.org/read.php?2,249997,250002#msg-250002
>
>
>
> ------------------------------
>
> Message: 2
> Date: Fri, 9 May 2014 23:05:41 +0100
> From: Jonathan Matthews <contact at jpluscplusm.com>
> To: nginx at nginx.org
> Subject: Re: subs filter error
> Message-ID:
> <
> CAKsTx7Cy2ahdy05DOJo00_ddRFoqy-oyQBNv4BdU-QOh5UJWtQ at mail.gmail.com>
> Content-Type: text/plain; charset=UTF-8
>
> On 9 May 2014 13:36, Tom McLoughlin <me at tommehm.com> wrote:
> > I keep getting this error every time someone loads a page.
> > subs filter header ignored, this may be a compressed response. while
> > reading response header from upstream, client: xx.xx.xx.xx, server: ,
> > request: "GET /search/sharepoint/0/7/0 HTTP/1.1", upstream:
> > "http://194.71.107.80:80/search/sharepoint/0/7/0", host: "tpb.rtbt.me",
> > referrer: "http://tpb.rtbt.me/search/sharepoint/0/99/"
>
> So why not stop the upstream responding with a compressed response?
>
> I know how to do this for TPB, having written a *14* line nginx config
> to do exactly the same thing, reverse proxying TPB for .. academic
> reasons. But you're trying to make money off them, so I don't feel
> like sharing. I'll let you figure it out. It's really not difficult.
>
> J
>
>
>
> ------------------------------
>
> Message: 3
> Date: Sat, 10 May 2014 16:24:57 +1200
> From: Steve Holdoway <steve at greengecko.co.nz>
> To: nginx at nginx.org
> Subject: Re: Caching servers in Local ISPs !!
> Message-ID: <1399695897.24481.647.camel at steve-new>
> Content-Type: text/plain; charset="UTF-8"
>
> You might want to look at lsyncd - a GZSOC project - to ease the
> synchronisation. I have had good results with it.
>
> Steve
> On Sat, 2014-05-10 at 00:22 +0500, shahzaib shahzaib wrote:
> > @itpp thanks for replying.
> >
> >
> > So on easy note, i would have to assign those machines the preferred
> > dns and use rsync on regular basis in order to make identical data
> > between local caching machines and main front end content servers ?
> >
> >
> > What if a client request a video which is not in local caching
> > server ? Does nginx has the configuration for it to check the files
> > locally and then forward the request to main content servers if
> > requested file is not cached locally ?
> >
> >
> > I need a bit of guidance in order to configure nginx this way.
> >
> >
> > Shahzaib
> >
> >
> >
> >
> > On Fri, May 9, 2014 at 11:49 PM, itpp2012 <nginx-forum at nginx.us>
> > wrote:
> > Its quite simple, think of it this way, a DNS entry does not
> > have to point
> > to the same IP everywhere.
> >
> > Place your cache machines at a ISP, have them assign its IP to
> > your
> > preferred dns name, thats about it.
> >
> > The rest like distribution works like a reverse riverbed with
> > a master
> > mirror, rsync or the likes.
> >
> > And of course this can all be done with nginx at all
> > locations.
> >
> > Posted at Nginx Forum:
> > http://forum.nginx.org/read.php?2,249997,250000#msg-250000
> >
> > _______________________________________________
> > nginx mailing list
> > nginx at nginx.org
> > http://mailman.nginx.org/mailman/listinfo/nginx
> >
> >
> >
> > _______________________________________________
> > nginx mailing list
> > nginx at nginx.org
> > http://mailman.nginx.org/mailman/listinfo/nginx
>
> --
> Steve Holdoway BSc(Hons) MIITP
> http://www.greengecko.co.nz
> Linkedin: http://www.linkedin.com/in/steveholdoway
> Skype: sholdowa
>
>
>
> ------------------------------
>
> Message: 4
> Date: Sat, 10 May 2014 14:19:37 +0500
> From: shahzaib shahzaib <shahzaib.cb at gmail.com>
> To: nginx at nginx.org
> Subject: Re: Caching servers in Local ISPs !!
> Message-ID:
> <
> CAD3xhrPbC-F_8cY2t+3JqspL3-g_RZM4sPYd7p40WxFcvboqSA at mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Thanks for replying guyz.
>
> Can i use nginx (origin and edge) ? As the question in following link.
>
>
> http://stackoverflow.com/questions/10024981/distributed-cached-mp4-pseudostreaming-seeking-with-nginx
>
> If i use the origin and edge method, i think i'll change my application
> codes to redirect local country traffic to edge webservers (ISP caching
> server for video files) and that edge server will check if the requested
> file is not in cache and it'll fetch the requested video file from origin
> web-server located in U.S and cache it to local.
>
> For this procedure,
>
> I'll have to configure DNS A entries against local ISP caching servers and
> put those DNS to my application code to stream videos from those LOCAL
> CACHING SERVERS for specific country.
>
> Please correct me if i am wrong.
>
>
>
>
>
>
> On Sat, May 10, 2014 at 9:24 AM, Steve Holdoway <steve at greengecko.co.nz
> >wrote:
>
> > You might want to look at lsyncd - a GZSOC project - to ease the
> > synchronisation. I have had good results with it.
> >
> > Steve
> > On Sat, 2014-05-10 at 00:22 +0500, shahzaib shahzaib wrote:
> > > @itpp thanks for replying.
> > >
> > >
> > > So on easy note, i would have to assign those machines the preferred
> > > dns and use rsync on regular basis in order to make identical data
> > > between local caching machines and main front end content servers ?
> > >
> > >
> > > What if a client request a video which is not in local caching
> > > server ? Does nginx has the configuration for it to check the files
> > > locally and then forward the request to main content servers if
> > > requested file is not cached locally ?
> > >
> > >
> > > I need a bit of guidance in order to configure nginx this way.
> > >
> > >
> > > Shahzaib
> > >
> > >
> > >
> > >
> > > On Fri, May 9, 2014 at 11:49 PM, itpp2012 <nginx-forum at nginx.us>
> > > wrote:
> > > Its quite simple, think of it this way, a DNS entry does not
> > > have to point
> > > to the same IP everywhere.
> > >
> > > Place your cache machines at a ISP, have them assign its IP to
> > > your
> > > preferred dns name, thats about it.
> > >
> > > The rest like distribution works like a reverse riverbed with
> > > a master
> > > mirror, rsync or the likes.
> > >
> > > And of course this can all be done with nginx at all
> > > locations.
> > >
> > > Posted at Nginx Forum:
> > > http://forum.nginx.org/read.php?2,249997,250000#msg-250000
> > >
> > > _______________________________________________
> > > nginx mailing list
> > > nginx at nginx.org
> > > http://mailman.nginx.org/mailman/listinfo/nginx
> > >
> > >
> > >
> > > _______________________________________________
> > > nginx mailing list
> > > nginx at nginx.org
> > > http://mailman.nginx.org/mailman/listinfo/nginx
> >
> > --
> > Steve Holdoway BSc(Hons) MIITP
> > http://www.greengecko.co.nz
> > Linkedin: http://www.linkedin.com/in/steveholdoway
> > Skype: sholdowa
> >
> > _______________________________________________
> > nginx mailing list
> > nginx at nginx.org
> > http://mailman.nginx.org/mailman/listinfo/nginx
> >
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <
> http://mailman.nginx.org/pipermail/nginx/attachments/20140510/b44f1a9a/attachment-0001.html
> >
>
> ------------------------------
>
> Message: 5
> Date: Sat, 10 May 2014 10:53:17 +0100
> From: Tom McLoughlin <me at tommehm.com>
> To: nginx at nginx.org
> Subject: Re: subs filter error
> Message-ID: <536DF70D.2050302 at tommehm.com>
> Content-Type: text/plain; charset=ISO-8859-1
>
> That's the only upstream I'm aware of that works with proxies.
>
> On 09/05/2014 23:05, Jonathan Matthews wrote:
> > On 9 May 2014 13:36, Tom McLoughlin <me at tommehm.com> wrote:
> >> I keep getting this error every time someone loads a page. subs
> >> filter header ignored, this may be a compressed response. while
> >> reading response header from upstream, client: xx.xx.xx.xx,
> >> server: , request: "GET /search/sharepoint/0/7/0 HTTP/1.1",
> >> upstream: "http://194.71.107.80:80/search/sharepoint/0/7/0",
> >> host: "tpb.rtbt.me", referrer:
> >> "http://tpb.rtbt.me/search/sharepoint/0/99/"
> >
> > So why not stop the upstream responding with a compressed
> > response?
> >
> > I know how to do this for TPB, having written a *14* line nginx
> > config to do exactly the same thing, reverse proxying TPB for ..
> > academic reasons. But you're trying to make money off them, so I
> > don't feel like sharing. I'll let you figure it out. It's really
> > not difficult.
> >
> > J
> >
> > _______________________________________________ nginx mailing list
> > nginx at nginx.org http://mailman.nginx.org/mailman/listinfo/nginx
> >
>
>
>
> ------------------------------
>
> Message: 6
> Date: Sat, 10 May 2014 06:39:55 -0400
> From: "itpp2012" <nginx-forum at nginx.us>
> To: nginx at nginx.org
> Subject: Re: Caching servers in Local ISPs !!
> Message-ID:
> <
> 461b89f745fbc7e6c616c28d3fa6a39f.NginxMailingListEnglish at forum.nginx.org>
>
> Content-Type: text/plain; charset=UTF-8
>
> See http://en.wikipedia.org/wiki/Content_delivery_network
> and http://en.wikipedia.org/wiki/File:Akamaiprocess.png
>
> Make yourself a HLD (high level design) before getting to technology.
>
> Posted at Nginx Forum:
> http://forum.nginx.org/read.php?2,249997,250007#msg-250007
>
>
>
> ------------------------------
>
> _______________________________________________
> nginx mailing list
> nginx at nginx.org
> http://mailman.nginx.org/mailman/listinfo/nginx
>
> End of nginx Digest, Vol 55, Issue 26
> *************************************
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.nginx.org/pipermail/nginx/attachments/20140510/2ffcfb1f/attachment-0001.html>
More information about the nginx
mailing list