W
W
weranda2018-03-11 12:38:55
Parsing
weranda, 2018-03-11 12:38:55

What to do with bad bots?

Hello

, I'm thinking. There are bots and parsers that do not bring anything useful to the site (alexa, ahrefs, grab, python-requests and others). What to do with them? Block via .htaccess / PHP or redirect to some page. What do you think about this?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
V
VladimirMelnik, 2018-03-11
@VladimirMelnik

It’s worth blocking if they carry a tangible load on the site (which is unlikely), otherwise it’s not worth it.

M
Mikhail Sisin, 2018-03-13
@JabbaHotep

It's a fight against windmills. If bots do not interfere with the work of the site, it is easier to put up with them. If they make it difficult, this is already a reason for legal prosecution.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question