B
B
Bjornie2017-11-05 18:08:27
Google
Bjornie, 2017-11-05 18:08:27

How to parse Google search results?

The question is rather not on the technique of which libraries to use, but on the experience of parsing. There is a need to search regularly (and a lot) for certain queries in the Google SERPs, visiting only the first page and analyzing the snippets of the first search results. Who had a similar experience, tell me what rake they stepped on and how best to carry out this task?

Answer the question

In order to leave comments, you need to log in

2 answer(s)
D
Dimonchik, 2017-11-05
@dimonchik2013

logged in is better

O
Odisseya, 2017-11-06
@Odisseya

We need an ip pool and their regular change + via API we connect the captcha solving service.
And to adjust empirically timeouts.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question