How in Robots to allow indexing of a directory that is deeper than the directory that is prohibited?

A

Anton R.2021-08-30 12:13:44

Search Engine Optimization

Anton R., 2021-08-30 12:13:44

In general, the essence is this, I have two ways:

1. www.site.ru/components - this one is by default prohibited from indexing
2. www.site.ru/components/my_component/images - but this folder needs to be allowed for indexing

Is it possible write a directive so that the search robot can go deep into the components/ directory, but only to a specific folder?

Reply

Answer the question

In order to leave comments, you need to log in

2 answer(s)

A

archelon, 2021-08-30
@archelon

It's simple:

Disallow: /components/
Allow: /components/my_component/images/

P

Puma Thailand, 2021-08-30
@opium

Standardly prescribe allow for him