L
L
lubezniy2019-12-17 16:42:04
Search engines
lubezniy, 2019-12-17 16:42:04

How can I prevent a site from being indexed by a specific search engine?

In connection with the recent events in Russian IT, it became undesirable to see one administered site in the issuance of one search engine, and only it. As I understand it, for this you need to somehow prohibit the indexing of the site by search robots of this system. Are there any settings intended for this, for example, in robots.txt? Or a list of User-Agent search engines for which content can be omitted?

Answer the question

In order to leave comments, you need to log in

1 answer(s)
P
prrrrrrr, 2019-12-17
@lubezniy

User-agent: StackRambler
https://devaka.ru/articles/list-of-search-bots

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question