A
A
Andrey_Dolg2020-06-02 09:17:30
Python
Andrey_Dolg, 2020-06-02 09:17:30

On which side can there be a plug with the maximum number of tcp connections?

I use aiohttp for scraping. Connections go through the layer of proxy servers (230), however, with more than 550 connections, a dump of proxy servers begins, and quite massively, sometimes all at once. On the proxy side of the provider, I connected access to more than 3k connections, but this did not solve the problem. Connections to the proxy are distributed evenly so that more than 3-4x per 1 does not go (yet). In general, I can not understand where to look for the problem.

Errors returned by connections
Cannot connect to host 45.87.248.222:80 ssl:default [Too many open files]

Answer the question

In order to leave comments, you need to log in

1 answer(s)
D
Dmitry Shitskov, 2020-06-02
@Andrey_Dolg

Judging by the error, you hit the limit of open descriptors. Can be raised manually via ulimit. How to install for your OS permanently depends on your OS

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question