How to identify popular search robots?

K

Ken Jee2015-09-29 00:49:08

PHP

Ken Jee, 2015-09-29 00:49:08

Has anyone faced the task of identifying the robots of popular search engines? Where can I see a list of their User-Agents. I'm going to implement it in PHP. Please share your content on this topic.

Reply

Answer the question

In order to leave comments, you need to log in

3 answer(s)

A

AlikDex, 2015-09-29
@Machez

Why write your own. if good people have long come up with?
Open git, look for crawler detect and bot detect
I use this one myself :
https://github.com/JayBizzle/Crawler-Detect

S

sivabur, 2015-09-29
@sivabur

User agents to determine:
Google https://support.google.com/webmasters/answer/10619...
Yandex https://yandex.ru/support/webmaster/robot-workings...
$google_query = $name_search_system + 'UserAgent';

M

mamayusha, 2017-01-21
@mamayusha

snipp.ru/view/78