Search robots cannot reach the site. What could be the problem?

M

moved_on2016-06-05 15:44:24

Google

moved_on, 2016-06-05 15:44:24

Site spb.dormall.ru
Works, everything is fine.
It all started with the fact that Robots.txt stopped loading in the webmaster - Failed to load robots.txt. Everything is ok in browser and console.
I tried to check if the site is available to search robots - no.
The same situation with Google.
What could be the problem?

Reply

Answer the question

In order to leave comments, you need to log in

3 answer(s)

L

landergate, 2016-06-05
@moved_on

For some reason, the DNS record "spb.dormall.ru" does not resolve for all users.
For me, for example, it does not open, as well as from a number of other servers from different parts of the Russian Federation and the world - it resolves somewhere, somewhere it does not.
The NS servers of the domain have two DNS providers: Fast DNS and Yandex.
dns.fastdns24.com
dns1.yandex.net
dns2.fastdns24.org
dns2.yandex.net
dns3.fastdns24.eu
dns4.fastdns24.link
Are you sure that spb.dormall.ru A-record is present both there and there?
If you maintain DNS records in only one place, without using the second, then it must be removed from the list of NS servers for the domain.

M

myfirepukan, 2016-06-05
@myfirepukan

1. Your site gives me a 404 page, check what's wrong
2. There is 1 page in Yandex, so somehow I could https://yandex.ru/search/?lr=47&clid=1955454&msid=...

M

moved_on, 2016-06-05
@moved_on

landergate - Thank you very much!
In order to connect mail to a domain, it was necessary to connect the domain to Yandex. And the entry with * was not added after that.
In the photo - as I just did. Do you think it will work?