Same root folder for multiple website different robots.txt

Vincent M. mouseless at free.fr
Sat Aug 7 11:35:14 UTC 2021


Le 06/08/2021 à 18:21, Francis Daly a écrit :
> On Fri, Aug 06, 2021 at 04:20:56PM +0200, Vincent M. wrote:
>
> Hi there,
>
>> Is it possible to tell the second server to link the file robots.txt to
>> another file like robots-pro.txt?
> Either of
>
>    location = /robots.txt { alias /var/www/website/prod/robots-pro.txt; }
>
>    location = /robots.txt { try_files /robots-pro.txt =404; }
>
> should work.
>
> In the first case, you list the absolute file name. In the second,
> you list the file within the normal "root" directory.
>
> Cheers,
>
> 	f

Yes, helped me a lot. For the main domain I did to block robots-denyall.txt:

         location /robots-denyall.txt {
                 return 404;
         }


And for the subdomain which I don't want to be referenced:

         location = /robots.txt {
                 alias /var/www/mywebsite/prod/robots-denyall.txt;
         }

Thank you :)


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.nginx.org/pipermail/nginx/attachments/20210807/1f6ddcd5/attachment.htm>


More information about the nginx mailing list