Firefox selenium webdriver: Page won't load until the end

Question

Python

I am using selenium and python to process a lot of pages. Sometimes some pages take a very long time to load (although visually all the necessary elements have loaded), the program execution is suspended during this time. If I press stop in the browser manually, the program continues to work. Is it possible to automatically stop the download when an element appears, or after some time. I googled. Similar questions appeared a year ago on stackoverflow and habré. The described methods of solving problems did not bring results. Neither set_page_load_timeout nor set_script_timeout help.

Answer 1

I used Selenium Library along with Rodot IDE and page loading was done with two commands:

Go To <url>
Wait Until Page Loaded

Sometimes, like in your case, we had to use a different bundle:

Go To <url>
Wait Until Element Visible <XPath>

Try looking at the documentation for the methods you're using, it might help.