D
D
Denis2019-12-19 09:39:33
robots.txt
Denis, 2019-12-19 09:39:33

Indexed despite being blocked in robots.txt?

This message came from Google. Indexed despite being blocked in the robots.txt file. Complains about the sitename/news/?PAGEN_1=11 format link. I looked in robots.txt and found the entry Disallow: /news/?PAGEN* , that is, the news section is forbidden for indexing? ..strange... Well, how to fix the service warning? Remove the entry Disallow: /news/?PAGEN* from robots.txt and that's it?

Answer the question

In order to leave comments, you need to log in

1 answer(s)
N
Notan Royamov, 2019-12-23
@Royamov

This is similar to preventing indexing of pagination pages (pagination), and not all news. In theory, nothing needs to be removed if you really want pagination pages not to be indexed. Google will destroy itself.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question