How to run +100 headless browsers on the server and have several tabs in them?

Question

Node.js

Colleagues, good day. I wanted to ask for an opinion, maybe someone has done similar things.
So, I am writing a project (bots), their essence is simple, they go to sites and do something. The first problem is there are a lot of 500+ of them, so it’s necessary)) the current implementation is a virtual machine in each running a browser, the bot itself in the form of an extension, in fact, performs tasks. This whole thing works through multilogin, the same is not a complaint. If anyone knows what multilogin is super))
I had a question to move away from virtual machines and run one multilogin and it has several profiles (browsers or browser profiles). As expected, all this tops ate all the memory. I launch a profile (browser) and it has several tabs 2 or 4 for example. Memory grows not strongly but grows. I restart the browser of course, but this does not really help. Only for a while.
Does anyone have an idea how to organize 100+ bots on one server through headless browsers and multilogin in particular? How to control memory consumption?
I will be grateful for advice.

Answer 1

IMHO, you take a queue system and workers, select a comfortable state of the number of workers / number of pages and manage your click-lust, you feel you are squandering resources, adding a new worker to this or a neighboring machine, and so on, as long as there is enough money for resources ....

Answer 2

If these headless browsers are gluttonous, then they should be abandoned where possible. Rewrite part of the bots in Python for example. It is possible that the problem is created by specific sites that Toli is mining on your Toli bot, loading unnecessary content. Need to monitor memory for each session.