D
D
Dmitry Skogorev2014-12-01 11:58:11
Bots
Dmitry Skogorev, 2014-12-01 11:58:11

Bots come to me?

I watch Yandex metrics.
For many days now, almost constantly I see visits from
priceg.com
cenoval.ru
1-2 visits with single views and 100% failures
, what could it be?
bots come in so that I go back to look?

Answer the question

In order to leave comments, you need to log in

3 answer(s)
F
facir, 2014-12-01
@facir

There are many different bots, some simply scan sites to analyze traffic, so that they can then compile a rating table, others simply enter information that such a site exists, there are also those that save pages like webarchive so that you can view changes over 2-6 years For example. Also, someone creates their own search engines and enters existing sites into the database.
But I also met bots that parsed pages with unique content in order to post it on their own.
They are not dangerous, they just collect information.
If this situation is annoying, you can always block them by writing rules in the .httaccess file
For example:
Where "^Baiduspider" is the name of the bot
SetEnvIfNoCase User-Agent "^Baiduspider" bad_bot
SetEnvIfNoCase User-Agent "^ia_archiver" bad_bot
SetEnvIfNoCase User-Agent "^priceg.com" bad_bot
Order Allow,Deny
Allow from all
Deny from env=bad_bot

A
ankfrv, 2014-12-01
@ankfrv

A similar problem, not very large-scale, but there. I just put such domains in the filter on Yandex.Metrica.

V
Vapaamies, 2015-01-09
@vapaamies

Similar question with an answer .

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question