Answer the question
In order to leave comments, you need to log in
Indexed despite being blocked in robots.txt?
This message came from Google. Indexed despite being blocked in the robots.txt file. Complains about the sitename/news/?PAGEN_1=11 format link. I looked in robots.txt and found the entry Disallow: /news/?PAGEN* , that is, the news section is forbidden for indexing? ..strange... Well, how to fix the service warning? Remove the entry Disallow: /news/?PAGEN* from robots.txt and that's it?
Answer the question
In order to leave comments, you need to log in
This is similar to preventing indexing of pagination pages (pagination), and not all news. In theory, nothing needs to be removed if you really want pagination pages not to be indexed. Google will destroy itself.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question