How to prevent certain text from being indexed via robots.txt?

P

peindigo2020-01-15 14:35:17

robots.txt

peindigo, 2020-01-15 14:35:17

How to prevent certain text or part of text from being indexed via robots.txt? Interested in the prohibition of text indexing only through robots.txt!

Reply

Answer the question

In order to leave comments, you need to log in

1 answer(s)

N

Notan Royamov, 2020-01-15
@Royamov

No way.
The robots.txt file only instructs the robots on whether to crawl and index specific URLs or sets of them, while robots can ignore them and still index pages if they do not use the Robots meta tag with a value of noindex.