How to quickly download folders and files from the server (more than 1 million files)?

Question

Computer networks

How to quickly download folders and files from the server (a lot of sites). sites more than 400 statics need to be downloaded to a computer, via shh it takes a long time to download the client. Maybe someone knows how fast?

Answer 1

Compress them on the server into an archive and download in one file.

Answer 2

Rclone / Rsync or compress and drag them into one file, you can compress, transfer and then decompress on the fly during reception
Something like this
transmission

tar -c /path/to/file/ | nc -l 3333

reception

nc example.com 3333 > tar -xvf -C /path

You can wrap not through nc, but through ssh and add compression if necessary
. But strictly speaking, I still recommend Rsync