B
B
babyaff2022-02-23 02:41:45
Automation
babyaff, 2022-02-23 02:41:45

Is it possible to scrape information from a site that requires authorization using a browser extension (chrome)?

Good day, dear programmers.
There is a task to automatically collect data from the site.

But to display this data, you need to login to the site, which occurs by calling the pop-up window of the browser add-on (chrome). And the subsequent interaction inside the pop-up extension window (pressing buttons, possibly entering a password).

I found information about popular solutions for scrapping and automation - puppeteer, playwright and about their inability to interact with browser-based solutions.

Is there any other way to automate such a process?

ps there is no api on the site

Answer the question

In order to leave comments, you need to log in

2 answer(s)
D
dollar, 2022-02-23
@dollar

Option 1) Open their extension and inject into the code. At a minimum, you can somehow open your API from their extension for your extensions and user scripts.
Option 2) Treat the browser as a complete third-party application. The task is to automate the work with the keyboard and mouse. Here we just move away from using JS as such and start parsing windows at the OS level, their elements, and images on them.

R
rPman, 2022-02-23
@rPman

The browser extension interface is also html with its own dom, which means you can interact with it.
Vulnerable extensions do not use their own page with the chrome-extension:// address, but simply add dom elements to the page, which is all the more simple with such ones.
browser automation tools allow you to work incl. with extensions like selenium, google extension automation selenium

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question