E
E
Eva052017-08-04 12:03:33
Python
Eva05, 2017-08-04 12:03:33

How to increase the performance of Python Selenium when scrolling down the page?

Good day to all . There is a page with goods, when scrolling down the page, new goods are loaded accordingly, etc., etc. (there are a lot of them, about 30,000 pieces). I use Selenium to scroll down the page and over time, the speed of loading more and more new products slows down, and the delay in loading new products grows exponentially
34b03433527e4618ba151ba5fd99d9d7.png
. Since there are a lot of pages loaded, as I understand it, a large amount of cache accumulates, which all this thing slows down. Is it possible to clear the cache in parallel with how selenium works, or other ways to make the computer slow down. Selenium has already disabled the display of pictures and other images.
It is not suitable to use requests, it is necessary to use Selenuim
Thank you!

Answer the question

In order to leave comments, you need to log in

1 answer(s)
E
Evgeny Palych, 2017-09-08
@xzKakoyLogin

Remove rendered elements in the DOM.
Especially if the "product" has events with the execution of js code, then it is necessary to clean up the page.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question