W
W
weranda2019-03-24 13:35:36
Google
weranda, 2019-03-24 13:35:36

Is it possible to index a page that is prohibited in robots.txt?

Hello The
question is theoretical. In robots.txt, a ban on indexing a specific page is registered. Is it possible to drive such a page into the Yandex and Google PS index? And can any PS bot visit such a page?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
A
Alexander Denisov, 2019-03-29
@Grinvind

You can drive. For example, put links to it. In the issue, such pages are rarely found that are closed from indexing.
5c9e6ccc75e99533814810.png

U
Uber Noob, 2019-03-24
@ubernoob

Can visit, cannot get into the index

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question