Answer the question
In order to leave comments, you need to log in
How to close all internal pages of a folder from scanning?
The site category has a large number of pages that I don't need. In this case, the category itself must be in the index. How to format it correctly through robots.txt?
Now I wrote it like this, but I don't know if it's right:
Disallow: /category
Allow: /category/$
Answer the question
In order to leave comments, you need to log in
Does your category page end with a slash?
If yes, then I would correct:
Disallow: /category/
Allow: /category/$
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question