Answer the question
In order to leave comments, you need to log in
What to do with bad bots?
Hello
, I'm thinking. There are bots and parsers that do not bring anything useful to the site (alexa, ahrefs, grab, python-requests and others). What to do with them? Block via .htaccess / PHP or redirect to some page. What do you think about this?
Answer the question
In order to leave comments, you need to log in
It’s worth blocking if they carry a tangible load on the site (which is unlikely), otherwise it’s not worth it.
It's a fight against windmills. If bots do not interfere with the work of the site, it is easier to put up with them. If they make it difficult, this is already a reason for legal prosecution.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question