Answer the question
In order to leave comments, you need to log in
How to scrape a site without a ban?
There is a need to pull the timetable from the Russian Railways website. It is necessary to download about 100 pages. How to programmatically make it so as not to attract attention and not get banned by ip?
So far, it only comes to mind to make a floating delay between pages 30 seconds-2 minutes.
Any other ideas?
Answer the question
In order to leave comments, you need to log in
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question