M
M
Mark Verbau2019-04-06 05:42:02
Search engines
Mark Verbau, 2019-04-06 05:42:02

Does the crawler understand server configuration?

Does the robot understand the configuration of the server, and can it cut traffic realizing that the site may not be able to withstand it?

Answer the question

In order to leave comments, you need to log in

3 answer(s)
A
Alexander Denisov, 2019-04-06
@verbau

No, he does not understand the configuration, but he checks the availability. Look in the Yandex bot logs and in the metrics for the uptime report. If the bots have code 200, and judging by the report, the site did not go down, then everything is buzzing. If the site is periodically not available, then yes, traffic will drop.

I
Ivan Shumov, 2019-04-06
@inoise

Not

D
Dimonchik, 2019-04-06
@dimonchik2013

config does not understand
traffic cuts

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question