Answer the question
In order to leave comments, you need to log in
How to increase the performance of Python Selenium when scrolling down the page?
Good day to all . There is a page with goods, when scrolling down the page, new goods are loaded accordingly, etc., etc. (there are a lot of them, about 30,000 pieces). I use Selenium to scroll down the page and over time, the speed of loading more and more new products slows down, and the delay in loading new products grows exponentially
. Since there are a lot of pages loaded, as I understand it, a large amount of cache accumulates, which all this thing slows down. Is it possible to clear the cache in parallel with how selenium works, or other ways to make the computer slow down. Selenium has already disabled the display of pictures and other images.
It is not suitable to use requests, it is necessary to use Selenuim
Thank you!
Answer the question
In order to leave comments, you need to log in
Remove rendered elements in the DOM.
Especially if the "product" has events with the execution of js code, then it is necessary to clean up the page.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question