How to selectively close a site for search robots?

S

softshape2016-09-20 13:26:05

robots.txt

softshape, 2016-09-20 13:26:05

Too many divorced robots. How can you selectively close the site for them? Leave GoogleBot, YandexBot, and that's all - all sorts of Megaindex only create an extra load on the site. How to get rid of them pointwise?

Reply

Answer the question

In order to leave comments, you need to log in

2 answer(s)

A

Alexey, 2016-09-20
@alsopub

You correctly indicated the tag - robots.txt - from here you have to dance.
For example - www.pixelplus.ru/samostoyatelno/stati/indeksatsiya...
Or is something specific not working or is there a way to do it?

A

Alexander Chernykh, 2016-09-20
@sashkets

web of search robots