T
T
Traney2014-05-02 14:50:28
Search engines
Traney, 2014-05-02 14:50:28

How to enter the site as a search bot?

I found a script that will check who is on the site, whether a bot (search engine) or a person. I output the script text that should appear only if there is a Google bot on the site. But I don't know how to check if the script works. Can someone tell me a service, a way. Google webmaster, too lazy to add a site there.

Answer the question

In order to leave comments, you need to log in

2 answer(s)
K
Konstantin Kozhin, 2014-05-02
@traney

Robots use their own UserAgents when sending HTTP requests to the server.
Example:
From here you can see that the Google bot has a UserAgent "Mozilla/5.0 (compatible; Googlebot/2.1; + www.google.com/bot.html) ".
In your browser, change the UserAgent to that of the Google bot - osxdaily.com/2013/01/16/change-user-agent-chrome-s...
Then go to the site and look at the result.
UserAgents of all bots are listed here - www.useragentstring.com/pages/Crawlerlist

A
aumk, 2014-05-02
@aumk

wait

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question