Answer the question
In order to leave comments, you need to log in
How to prevent PS from indexing a site?
Good day everyone!) Tell me how to prevent search engines from indexing all pages of the site? So that in the search engines it was not at all.
Answer the question
In order to leave comments, you need to log in
First read about robots.txt . Then create a file and add these two lines to it:
User-agent: *
Disallow: /
Prohibit indexing - no way.
Ask not to be indexed - via robots.txt. The lion's share of search engines / robots reads this file, but there are also all sorts of non-naturals (although it's hard to call them search engines, rather parsers of shitty content in order to rummage around it later at home).
The robots.txt file in the root of the site
in the file:
User-agent: *
Disallow:
help.yandex.ru/webmaster/controlling-robot/robots-...
In short, put the robots.txt file in the root of the site and write in it
User-agent: *
Disallow: /
robots.txt controls crawling, not indexing.
indexing can be disabled. There is a robots noindex meta tag for this .
Not to be confused with the noindex tag , which is not supported by all PSs. For example, Google does not support.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question