Answer the question
In order to leave comments, you need to log in
What should I do if the Functions in Celery tasks hang and block the work of the entire Celery?
Hello. I use Celery, Celery beat, Redis, Python, Selenium
In Celery tasks, I access different sites through Selenium and get information from them. Scheduled every minute.
Sometimes sites don't have an element or it doesn't load or something. All this eventually leads to Celeri freezing and the application not working. What should I do and how to separate each task from the impact on the application? Like, if there is a problem or a hang, the task is killed.
I tried this https://selenium-python.readthedocs.io/waits.html#...
And time limit for task.
Does not help. Yes, if the element is not found, this improves the situation a little, but if the task freezes, that's it, kaput.
Answer the question
In order to leave comments, you need to log in
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question