P
P
peindigo2020-01-15 14:35:17
robots.txt
peindigo, 2020-01-15 14:35:17

How to prevent certain text from being indexed via robots.txt?

How to prevent certain text or part of text from being indexed via robots.txt? Interested in the prohibition of text indexing only through robots.txt!

Answer the question

In order to leave comments, you need to log in

1 answer(s)
N
Notan Royamov, 2020-01-15
@Royamov

No way.
The robots.txt file only instructs the robots on whether to crawl and index specific URLs or sets of them, while robots can ignore them and still index pages if they do not use the Robots meta tag with a value of noindex.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question