Answer the question
In order to leave comments, you need to log in
How to force bots, including GoogleBot, not to visit non-existent pages of the site?
They did 301 redirects from old pages to new ones - all the same, Google and other systems remember these addresses and go to them a year later. Put 410 response. This will make it clear to the systems that it is necessary to no longer go to this address?
I don’t like it because it clogs the logs and makes the load on the site.
Answer the question
In order to leave comments, you need to log in
Google and other systems remember these addresses and go to them a year later.
Put 410 response.why? leave a redirect
I don’t like it because it clogs the logs and makes the load on the site.Logs are needed for this, in order to know what is happening, complaining about "cluttering the logs" is generally stupid. And if this also causes a load, then it is better to spend time optimizing the work of the site code.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question