Answer the question
In order to leave comments, you need to log in
How to disable indexing of such links through robots?
Hello. Tell me please.
There is a Xenforo forum, connected to the POISON webmaster, I see that the bot is looking for pages with incorrect endings, it seems to me that this should not be done, how to limit such endings?
Answer the question
In order to leave comments, you need to log in
It’s better to write
robots.txt on them, it doesn’t always save. And the bots still follow the links... if they exist. The question is what do you need it to index. To close from indexing is best! <meta name="robots" content="noindex, follow">
<meta name="robots" content="noindex, follow">
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question