A
A
Anton R.2021-08-30 12:13:44
Search Engine Optimization
Anton R., 2021-08-30 12:13:44

How in Robots to allow indexing of a directory that is deeper than the directory that is prohibited?

In general, the essence is this, I have two ways:

1. www.site.ru/components - this one is by default prohibited from indexing
2. www.site.ru/components/my_component/images - but this folder needs to be allowed for indexing

Is it possible write a directive so that the search robot can go deep into the components/ directory, but only to a specific folder?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
A
archelon, 2021-08-30
@archelon

It's simple:

Disallow: /components/
Allow: /components/my_component/images/

P
Puma Thailand, 2021-08-30
@opium

Standardly prescribe allow for him

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question