Answer the question
In order to leave comments, you need to log in
Guys robots_ssl.txt or robots.txt?
There is such a websiteauditor software that says that a site with a secure protocol should have a document of the form: robots_ssl.txt and so I haven’t seen anything like this anywhere in the recommendations, someone can give a link or shed some light.
PS I even use the good old robots.txt on https and everything works fine!
Answer the question
In order to leave comments, you need to log in
There are situations when the secure https protocol is used only for certain pages on the site (usually a contact form, an order form, and other pages where users can enter personal data).
To close such pages from indexing, they make a separate version of the instructions, which will be available via a secure protocol.
Create a robots_ssl.txt file (you can use any file name) and configure the server settings so that when you request https://domain.com/robots.txt file opens.
To do this, the necessary parameters are written in .htaccess:
RewriteEngine on
Options +FollowSymlinks
RewriteCond %{SERVER_PORT} ^443$
RewriteRule ^robots.txt$ robots_ssl.txt
https://www.google.com/robots_ssl.txt
https://www.google.com/robots.txt
https://www.yandex.ru/robots_ssl.txt
https://www.yandex.ru/robots .txt
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question