A
A
Alexander Konovalov2014-07-01 12:48:43
Google
Alexander Konovalov, 2014-07-01 12:48:43

How to prevent PS from indexing a site?

Good day everyone!) Tell me how to prevent search engines from indexing all pages of the site? So that in the search engines it was not at all.

Answer the question

In order to leave comments, you need to log in

5 answer(s)
K
KEKSOV, 2014-07-01
@Huf

First read about robots.txt . Then create a file and add these two lines to it:

User-agent: *
Disallow: /

V
Vlad Zhivotnev, 2014-07-01
@inkvizitor68sl

Prohibit indexing - no way.
Ask not to be indexed - via robots.txt. The lion's share of search engines / robots reads this file, but there are also all sorts of non-naturals (although it's hard to call them search engines, rather parsers of shitty content in order to rummage around it later at home).

S
Sergey, 2014-07-01
@TsarS

The robots.txt file in the root of the site
in the file:

User-agent: *
Disallow:

Y
Yuri Lobanov, 2014-07-01
@iiil

help.yandex.ru/webmaster/controlling-robot/robots-...
In short, put the robots.txt file in the root of the site and write in it

User-agent: *
Disallow: /

A
Andrey Lipattsev, 2015-01-23
@HabrAndrey

robots.txt controls crawling, not indexing.
indexing can be disabled. There is a robots noindex meta tag for this .
Not to be confused with the noindex tag , which is not supported by all PSs. For example, Google does not support.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question