fStrange2020-07-29 10:41:23
Search engines
fStrange, 2020-07-29 10:41:23

Adsbot/3.1 whose bot? - Mozilla/5.0 (compatible; Adsbot/3.1) - "Mozilla/5.0 (compatible; Adsbot/3.1)"

Already the second site I notice is indefatigably loading.

Google does not have it in the list of bots. IP American according to bases.

Answer the question

In order to leave comments, you need to log in

2 answer(s)
wisgest, 2021-04-03

User-Agent has become more meaningful:

Mozilla/5.0 (compatible; Adsbot/3.1; +https://seostar.co/robot/)

Ban in robots.txt
User-agent: Adsbot
Disallow: /

followed before.

Ivan Yakushenko, 2020-07-29

IP - most likely a proxy.
I myself used a similar User-Agent for parsing several times. So most likely you are being parsed.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question