Answer the question
In order to leave comments, you need to log in
Why do search engines block pages when indexing?
I go to google webmaster, open the blocked resources for the contribution and see the following:
1.
2.
Please comment on this situation, I guess the main one is also blocked?
Robots.txt looks like this (cms Joomla):
User-agent: *
Disallow: /administrator/
Disallow: /bin/
Disallow: /cache/
Disallow: /cli/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /layouts/
Disallow: /libraries/
Disallow: /logs/
Disallow: /modules/
Disallow: /plugins/
Disallow: /tmp/
Allow: /components/
Allow: /index.php?option=com_xmap&view=xml&id=1
User-agent: Yandex
Disallow: /administrator/
Disallow: /bin/
Disallow: /cache/
Disallow: /cli/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /layouts/
Disallow: /libraries/
Disallow: /logs/
Disallow: /modules/
Disallow: /plugins/
Disallow: /tmp/
Allow: /components/
Allow: /index.php?option=com_xmap&view=xml&id=1
Host: http://web-kreditor.ru
User-agent: Googlebot-Image
Allow: /images
User-agent: YandexImages
Allow: /images
Sitemap: http://web-kreditor.ru/index.php?option=com_xmap&view=xml&id=1
Answer the question
In order to leave comments, you need to log in
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question