Answer the question
In order to leave comments, you need to log in
Website parsing Python + Beautifulsoup. A waiting spider?
Tell the student what methods can make the parser wait? Goal: The script should sit on the site until the final data is shown (approximately 10 minutes). Data is added to the table at different time intervals.
Answer the question
In order to leave comments, you need to log in
You can use one like this .
Example:
import schedule
import time
def job():
print("I'm working...")
schedule.every(10).minutes.do(job)
schedule.every().hour.do(job)
schedule.every().day.at("10:30").do(job)
schedule.every().monday.do(job)
schedule.every().wednesday.at("13:15").do(job)
schedule.every().minute.at(":17").do(job)
while True:
schedule.run_pending()
time.sleep(1)
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question