Answer the question
In order to leave comments, you need to log in
How to hide a site from indexing?
The site is still under development, therefore, there is now test data and I would not want anyone to get there at all. So /robots.txt of my site contains the following content:
and if you drive the domain into search engines, they find the main page. Until recently, Google also showed several pages from the site, now only the main one. I understand that the robots do not work or is this a normal situation? Making access to the site by ip is not an option, because I have a regular dynamic IP address at home
Answer the question
In order to leave comments, you need to log in
Make authorization at the server level. No one, including the PS, will be able to access the site without a username and password.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question