B
B
BlagoYar Silence2021-10-14 17:41:21
Bots
BlagoYar Silence, 2021-10-14 17:41:21

How to block harmful search bots?

Access was denied in robots.txt, but how to block them, because some people eat a lot of traffic.

Answer the question

In order to leave comments, you need to log in

2 answer(s)
A
Antonio Solo, 2021-10-14
@solotony

it is necessary to analyze the user agent at the level of the web server (.htaccess) or directly the script
if the load from the bots is excessive - after the bot is detected, a firewall rule is created

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question