A
A
Armand M2015-08-31 18:29:14
Search Engine Optimization
Armand M, 2015-08-31 18:29:14

How to set up robots.txt?

Robots is set up. But one point is not clear.
I need the rubrics to be open for indexing, but the rubric pages are closed, i.e. there are no duplicate rubrics due to pagination.
Now I have this line in my robots:
Disallow: /category/*/*
http://site.ru/category/category/ - this should be indexed
http://site.ru/category/category/page/2/ - this is not necessary

Answer the question

In order to leave comments, you need to log in

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question