Answer the question
In order to leave comments, you need to log in
How to prevent child pages of a section from being indexed in robots.txt?
Hello.
I have a page like: site.ru/clients/client_name.
In robots, trying to hide the child pages of the "clients" section, I wrote the following instruction: Disallow: /clients/, but the parent itself was also hidden. How to avoid this and hide only the name of the clients?
Answer the question
In order to leave comments, you need to log in
Better close client pages via meta robots noindex,nofollow. So it will be more correct.
Do this:
Allow: /clients/$ - Allows indexing only this url
Disallow: /clients/* - Prohibits indexing everything after the slash
Check through the Google webmaster panel and Yandex
Like, if it helped)
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question