A
A
Arsen Abakarov2017-06-05 22:31:08
Python
Arsen Abakarov, 2017-06-05 22:31:08

Are celery tasks hanging?

The parser is spinning on the server
Each url is parsed as a separate task in celery
Runs like this -c 8 maxtasksperchild 20
And the whole thing often just hangs dead
Tried to set a time limit for the execution of one task, but did not snatch the limit
How can I identify the problem?
In fact, when the messages hang in the work, nothing works, the logs of information almost do not give, if you bang the supervisor with celery, then hung workers may remain in the processes

Answer the question

In order to leave comments, you need to log in

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question