D
D
Denis Bukreev2016-07-29 02:14:03
robots.txt
Denis Bukreev, 2016-07-29 02:14:03

How to properly set up robots.txt in my case?

I did not find the exact solution to my question.

I have a system of subdomains using redirects in .htaccess:
on the server at the root, I created a folder www, which contains folders like "subdomain.domain.com"
as a result, when you enter in the address bar, for example, code.domain.com, htaccess redirects along the path /www/code.domain.com
while the address remains the same - code.domain.com

And here's the question: how to properly prohibit the indexing of directories inside www?

I wrote the directive like this:
Disallow: /www/code.domain.com/
But I'm not sure and I can't even check if it will work.

Answer the question

In order to leave comments, you need to log in

2 answer(s)
S
SergeySL, 2016-07-29
@denisbookreev

Are multiple folders being redirected to the same domain? What is the purpose of this?

L
lolhunter, 2016-08-03
@lolhunter

Didn't quite understand
. Did you implement subfolders through subdomains?
If I understand correctly, then create robots.txt in each subdomain folder and set Disallow there as you need.
You can check the indexing of a particular link in webmaster tools, either Google or Yandex.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question