Answer the question
In order to leave comments, you need to log in
What to write in the robots.txt file for Modx?
The question arose, what should the correct robots.txt file for modx look like? All resources say that these directories must be closed from indexing, that is, like this:
User-agent: *
Disallow: /manager/
Disallow: /assets/components/
Disallow: /core/
Disallow: /connectors/
Disallow: /index.php
Disallow: *?
But, if for security reasons the manager, core, connectors directories were renamed, what was the point of changing their names if these names were then written in robots.txt? What then to specify in robots.txt and how to close directories unnecessary for seo from indexing?
Answer the question
In order to leave comments, you need to log in
In these lines:
No sense, because. if the permissions are set correctly, they will return 403.
Add:
Host: site.com
Sitemap: site.com/sitemap.xml
If renamed, they should not be specified in robots.txt.
It is better to delete this line too, because some of the styles can be read from the directory with the components.Disallow: /assets/components/
The file can be created through the generator capyba.ru/services/tools/robots/
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question