S
S
Samedi_Da_Kapa2019-01-22 16:30:18
Ruby on Rails
Samedi_Da_Kapa, 2019-01-22 16:30:18

The difference between a human and a bot in traffic?

There was an idea to practice and write a crawler. And then the question arose - how is the site checked, a person or a bot?
I'll expand my thought. I go to the same page from the browser and run my craft. As a matter of fact, it does nothing except:
session.visit 'url'
session.save_and_open_page
If I enter, everything is fine, if the bot is redirected. Its User-Agent is exactly the same as that of the browser. I would understand if the screening happened later - cursor tracking, time, etc. How are we distinguished?
PS RoR, Capybara + Poltergeist

Answer the question

In order to leave comments, you need to log in

2 answer(s)
S
stratosmi, 2019-01-22
@stratosmi

A person cannot with such precise intervals of time and so long in a row and so often.
Plus a person has JS.
You do not request anything in Ruby through JS.
I would look towards SlimerJS, PhantomJS.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question