Answer the question
In order to leave comments, you need to log in
How to set up robots.txt?
Robots is set up. But one point is not clear.
I need the rubrics to be open for indexing, but the rubric pages are closed, i.e. there are no duplicate rubrics due to pagination.
Now I have this line in my robots:
Disallow: /category/*/*
http://site.ru/category/category/ - this should be indexed
http://site.ru/category/category/page/2/ - this is not necessary
Answer the question
In order to leave comments, you need to log in
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question