Answer the question
In order to leave comments, you need to log in
The difference between a human and a bot in traffic?
There was an idea to practice and write a crawler. And then the question arose - how is the site checked, a person or a bot?
I'll expand my thought. I go to the same page from the browser and run my craft. As a matter of fact, it does nothing except:
session.visit 'url'
session.save_and_open_page
If I enter, everything is fine, if the bot is redirected. Its User-Agent is exactly the same as that of the browser. I would understand if the screening happened later - cursor tracking, time, etc. How are we distinguished?
PS RoR, Capybara + Poltergeist
Answer the question
In order to leave comments, you need to log in
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question