How to run many parallel tasks in celery and not die?

Question

Django

There is a monitoring service on Django. He checks something there according to the schedule. Checks are run through celery. The problem arises when many targets freeze at the same time. celery tasks have a timeout of 30 seconds. When checking once every five minutes, a dozen hung tasks are enough to clog the entire queue.
We cannot run many celery workers, because a system with five workers no longer fits into a virtual machine with 1 GB of memory.
How can this problem be solved? How to radically reduce the memory consumption of workers?

Answer 1

See why tasks hang and solve the source of the problem, not the consequences.