I
I
Igor Pavlenko2016-05-16 22:35:34
Search Engine Optimization
Igor Pavlenko, 2016-05-16 22:35:34

Why does Yandex take a long time to index new pages?

The site has a number of articles that bring very little traffic, these articles are added regularly, but the problem is that Yandex has not indexed new pages for quite a long time (obviously more than a week). The articles are not plagiarism or stupid reprints, the site is also of high quality and for some queries (already) is in the top 3 of the issue. About any seo-re-optimization is also out of the question.
On the technical side, there are also no problems, I checked everything several times, only what really should be closed is closed from indexing.
What could be the reason for such a long indexing? I read that Yandex more often visits sites that add content with some regularity, maybe the site is too young,for Yandex to draw such conclusions? The site is about a month old.
It is also very strange that some pages are still in the index and feel great there.

Answer the question

In order to leave comments, you need to log in

2 answer(s)
M
Maxim, 2016-05-17
@m77x

Unfortunately, while working as a consultant on one of the FREE hostings, such questions often arose in the workflow.
According to the frequency of errors, there were:
1) htaccess was configured incorrectly (Yandex bots were blocked)
2) The site was not optimized: loading 100500 extra files and vinaigrette in queries to MySQL.
3) If you are on free hosting or hosting with preventive overload protection.
I will dwell on the third point in more detail:
- hosting limits the frequency of requests to the site, so when a Yandex bot comes in, it can "blow out" an extremely large number of requests (and often does).
Therefore, the server often does not respond and your page is not available for loading by the bot.
Try using the directive in robots.txt Crawl-delay . Most often, after applying this directive, sites are perfectly indexed by Yandex.

P
Pavel Designer, 2016-05-17
@pozZzitiv

Guys, what do you advise here at all?))) Technical optimization is correct, but the question is about something else. It is written that the site is only a month old, which means the reasons are different.
Firstly , Yandex updates search results + - 1-2 times a week. Register with Yandex Webmaster and receive notifications of updates. Moreover, the pages indexed by the robot BEFORE the mid-afternoon update get into the issue. Those. There were updates on May 9th, May 12th and May 17th. So, on May 17, pages that were indexed by the robot BEFORE May 12 will get into the index. The next update will include pages indexed BEFORE May 17, etc. By the way, the dates are real for the last month, Yandex surprises with the frequency of updates for the last 2 months.
Secondly, the young site is not yet known to Yandex and it only tastes it. When he realizes that the site is alive and developing, he will visit the site regularly and the pages will appear in the index the same regularly.
My domain hung empty for a long time, and the first month after the launch, the bot only got used to the fact that the site came to life. So just keep these facts in mind and don't expect a new page in the index earlier than in 1-2 weeks.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question