How to download a site based on js framework?

X

XRave2021-12-12 02:54:41

Wget

XRave, 2021-12-12 02:54:41

How to download information from getcourse.ru for offline access.

Reply

Answer the question

In order to leave comments, you need to log in

2 answer(s)

V

Vindicar, 2021-12-12
@Vindicar

Two ways.
1. If the site does not fight with parsers, find out what chain of ajax requests is required to get the necessary data, and do it yourself. This is tedious at first, but the implementation will be less resource intensive.
2. If struggling, use a headless (or not so headless) browser that can execute JS.
For python, there is selenium, for other languages there are probably their own analogues.

T

ThunderCat, 2021-12-12
@ThunderCat

selenium, puppeteer, headless chrome. Or any other web driver. As an option - to drag all Ajax requests separately, but IMHO this is too expensive for the code.