How to deal with multiple workers and "could not obtain a database connection within 5.000 seconds"?

Question

Ruby on Rails

I have about a couple of dozen workers who do something there and Sidekiq launches them. It is planned that about 50 more pieces will be added. But the trouble is, they all write certain information into a certain table. Not just like that, but to the point. And sometimes, or rather often happens "could not obtain a database connection within 5.000 seconds". I have already set pool = 10, it's still not enough. Doing 1 pool for each worker is bad. But how then to solve the problem?
As I understand it, it is necessary to throw all requests in the queue or do something like check if the database is free and wait until it is free. However, there is no knowledge of this kind and I don’t really understand what exactly to dig.
Can anyone suggest the best way to resolve the issue? Or how do the right guys do?) Thank you

Answer 1

https://brandur.org/postgres-queues

Answer 2

Правильные лузгают семки
Девопсы советуют настроить СУБД под свою нагрузку

Answer 3

1. Определяешь глобальную переменную, к примеру SIDEKIQ_CONCURRENCY в .env
2. Запускаешь sidekiq через rake задачу с указанием concurrency, примерно так:

namespace :sidekiq do
  desc "TODO"
  task start: :environment do
    exec "sidekiq -c #{ENV['SIDEKIQ_CONCURRENCY']}"
  end
end

3. В database.yml добавляешь:
pool: <%= ENV['SIDEKIQ_CONCURRENCY'].to_i + 5 %>