M
M
MazHaz2019-02-12 13:03:35
robots.txt
MazHaz, 2019-02-12 13:03:35

How to close a subsection in robots.txt from the index?

How to properly close a subsection in robots.txt from indexing, but at the same time, so that the internal sections of this subsection would not be closed?
For example:
http//my.site/catalog /natyazhnye-potolki/ v-zal/
but subsection /v-zal/ should not be closed

Disallow: /natyazhnye-potolki/
it doesn't work like that.
All this is necessary for the experiment.

Answer the question

In order to leave comments, you need to log in

2 answer(s)
I
igorux, 2019-02-13
@igorux

Disallow: /natyazhnye-potolki/
Allow: /natyazhnye-potolki/v-zal/ #subsection allowed
Allow: /natyazhnye-potolki/*/ #all subsections are allowed one slash)

A
Alexey Kurilkin, 2021-08-19
@aleks_ku

Disallow: / catalog /natyazhnye-potolki/$ #closes only the / catalog /natyazhnye-potolki/ page, without disabling internal pages

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question