Yandex conflicts with selenium Python. What to do?

M

MelsikProgger2020-09-13 15:40:55

Python

MelsikProgger, 2020-09-13 15:40:55

When trying to parser https://realty.yandex.ru , yandex displays a window asking you to fill in the captcha:
oops... We're sorry, but the requests received from your IP address are similar to automatic ones

. How to avoid this. Help, I really need it!

Reply

Answer the question

In order to leave comments, you need to log in

3 answer(s)

S

Sergey Gornostaev, 2020-09-13
@sergey-gornostaev

Yandex does not conflict, Yandex successfully protects itself from parsing. To avoid this, you need to be smarter than Yandex developers and bypass their protection.

R

Ronald McDonald, 2020-09-13
@Zoominger

We're sorry, but requests coming from your IP address seem to be automated

Well, that's right, go for a walk, Vasya.
You can only win with a list of proxies through which to drive requests, but public proxies have also been on the black list of any popular site for a long time. Paid can ride.

A

afterters, 2020-09-13
@efters

Yandex, of course, does not really like being parsed. If you really need to get around this, then you can either use the API of some site with a proxy (for a fee). Every time Yandex asks to solve a captcha, change the proxy to a new one, perhaps the old proxies can be reused after some time.
The second option is to connect a service for solving captcha (also for a fee).