Parsing speed, the first time 5 minutes, the second time 1 minute, how so?

Question

Python

I have a parser, in short what it does: it parses pictures from the site and splits them into folders.
The execution time is very important to me (how quickly this script will be executed)
And now, running the first time, 8 folders were parsed in 5 minutes and 30 seconds, running the second time for about a minute. Probyval to clean the cache (in the command line ipconfig / flushdns) the result is the same 1 minute
How so?

Answer 1

there is still a cache on the server
measure the connection speed separately, the folder layout separately

Answer 2

Maybe he does not download files again?
Scrapy, for example, has a mechanism in the image pipeline to avoid re-downloading non-outdated files.

Answer 3

Clear the file cache, ipconfig /flushdns clears the cache of dns queries