Answer the question
In order to leave comments, you need to log in
Adsbot/3.1 whose bot?
216.18.204.134 - Mozilla/5.0 (compatible; Adsbot/3.1)
173.231.59.205 - "Mozilla/5.0 (compatible; Adsbot/3.1)"
Already the second site I notice is indefatigably loading.
Google does not have it in the list of bots. IP American according to bases.
Answer the question
In order to leave comments, you need to log in
User-Agent has become more meaningful:
Mozilla/5.0 (compatible; Adsbot/3.1; +https://seostar.co/robot/)
User-agent: Adsbot
Disallow: /
IP - most likely a proxy.
I myself used a similar User-Agent for parsing several times. So most likely you are being parsed.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question