What libraries or techniques can be used to upload more than 150,000 products from a csv file to Bitrix IM so that the site does not go down during this time?

Question

1C-Bitrix

There is a file with >150000 lines, these are goods. They must be uploaded to a site managed by Bitrix via api. How to upload is clear, but more than one site does not pull such a file.
What are the tricks or libraries, and how can I optimize the code to load everything.

Answer 1

How to upload is clear, but more than one site does not pull such a file.

If how to unload is clear, then what's the problem then?

Answer 2

greatly increase the running time of scripts in php max_execution_time and the maximum file size
max_upload_file

Answer 3

In any case, you put the site down, the only question is for how long.
You can put it conditionally for 2 hours and load all the goods at once, or you can put it for 1-2 seconds every 5 minutes, but then the import will take a couple of days.

Answer 4

Upload via command line (cli), it's much faster than via apache, nginx.
150k goods, well, it's only 20 minutes on bad hosting. Can be loaded at night