How to graze a site in which content is displayed with a delay?

Question

Python

The bottom line is that there is a site on which you log in, you go to the desired page and there, after loading the main information, additional data is loaded into the html table, the question is: how to wait for the additional information to be loaded and parse it, I tried the requests + bs4 bundle, I can’t figure out how to pause to wait for the load elements,
selenium does not offer

Answer 1

There is such a tab in the Network in the Developer Tools in the browser, it displays all network requests outgoing from the active page. See what is requested at the moment before the main content is loaded. Rewrite this query in Python. All!
The only thing is that sometimes cookies from the main page may be required for AJAX to work correctly. Then make a requests session, request the main page (you won’t need it yourself), and then perform the necessary AJAX in the same open session.

Answer 2

How to work with ajax