RSS

[Valentin V. Bartenev]

On Monday, 9 July 2018 11:27:58 MSK Gena Makhomed wrote:
> On 09.07.2018 10:41, Sergey Budnevitch wrote:
> 
> >> https://hg.nginx.org/nginx/atom-log
> >> https://hg.nginx.org/pkg-oss/atom-log
> >> https://hg.nginx.org/nginx.org/atom-log
> >>
> >> stop working, instead of RSS feed html+javascript returned.
> >> RSSOwl can't execute javascript and don't see these RSS feeds.
> >>
> >> Also I can't download http://hg.nginx.org/nginx/archive/tip.tar.gz
> >> with curl - also html+javascript returned, which curl don't understand.
> >>
> >> can you please fix these issues?
> 
> > atom-tags, atom-log, archive were removed from bot mitigation mechanism
> 
> thank you! but issue not fixed for these urls:
> 
> http://hg.nginx.org/pkg-oss/atom-log
> https://hg.nginx.org/pkg-oss/atom-log
> 
> http://hg.nginx.org/nginx.org/atom-log
> https://hg.nginx.org/nginx.org/atom-log
> 
> - they still return html+javascript.
> 
> P.S.
> 
> bot mitigation mechanism written as custom "C" module
> or written using only njs, without 3rd party modules?
>

It's pretty easy to write one using only njs.

 
> it is closed source code or will be open source code?
> 
> bot mitigation mechanism via javascript good for bots,
> but it also disables site indexing by search engines.(?)
> 
> it will be good to whitelist search engines by DNS,
> at least main search engines: Google, Yandex and Bing.
[..]

All main search engines are able to run JS.  Nowadays there're
a lot of JS-only sites.

  wbr, Valentin V. Bartenev