How to determine the useragent, which obviously belongs to bots, etc. (not real visitors)?

A

Andrey Privalov2015-06-01 15:34:07

Computer networks

Andrey Privalov, 2015-06-01 15:34:07

Is there any list or set of rules by which you can determine the useragent that belongs to real visitors?
Purpose: to separate all requests coming from bots (including search engines) and other garbage from requests coming from real visitors through the browser.

Reply

Answer the question

In order to leave comments, you need to log in

1 answer(s)

E

egor_nullptr, 2015-06-01
@negasus

www.robotstxt.org/db.html
www.botsvsbrowsers.com