How to unblock access to URL in robots.txt file?

F

FIKSER2018-07-21 16:52:27

Search Engine Optimization

FIKSER, 2018-07-21 16:52:27

ROBOTS.TXT
SITEMAP.XML

What am I doing wrong?

Reply

Answer the question

In order to leave comments, you need to log in

1 answer(s)

E

Evgeny Yudin, 2018-07-21
@RotgarSett

This is very similar to a glitch as there are no rules in robots.txt forbidding these URLs. As a temporary solution, I will suggest adding allow lines to robots.txt for each blocked URL and send it to Google for verification.
It is also very doubtful, but theoretically it is somehow possible that Disallow: */page/ does not allow sitemap URLs to be indexed:
Value: https://phuket-discount.ru/sitemap-pt-page-2015-07.xml
Value: https: //phuket-discount.ru/sitemap-pt-page-2015-08.xml