Website scraper with proxy?

Question

Parsing

Hello. Advise what is best to use.
You need to make a parser for the site, but in order to parse, you need to press buttons. Cookies are not needed, but dynamic proxy switching is needed (so that the site is not banned).
Thank you.

Answer 1

Puppeteer is here to help.

Answer 2

If you are familiar with Python, you can use the Python + Scrapy + Splash + Proxy bundle - you get a very powerful system that can do everything you need, from parsing simple sites to sites that work with front-end frameworks.

Answer 3

You can use regular python requests with tor binding if the buttons do not need to be pressed, and if the site requires full-fledged work, then as selenium webdriver said above. Of the minuses of selenium-a, I can single out so far only limited input / output / interactive emulation with a web page. Perhaps this is how optimization works, but there is definitely a minus in this.