I inherited 70 GB of pictures in 1 folder, they are scattered over “subfolders” - is this generally normal?

Question

linux

My ssh "slows down" when opening this folder at least for viewing when connecting to the server.
Linux Debian.
70 pictures in jpeg format + their thumbs.
You need to "pump" into a new project from the old one.
Will I pump it out on SCP? With this behavior MC when trying to at least open a folder.

Answer 1

pack and merge the archive, you can break it into pieces of 1-2 gigabytes.
but in general - not to say that this is the best practice, but the system will still reach the specific file along the way instantly. Listing takes a long time, but in web projects, directory listing is usually not required.

Answer 2

Why are you viewing these files via SSH?
You still won't be able to view them.
Yes, you can easily download it using * as the filename, for example.

Answer 3

they are scattered in "subfolders"

This is normal, because if 70GB of pictures were lying around in one folder, not only ssh would slow down, but the site as a whole.
I once had this, and I acted in the following perverted way:
I shoveled all the news that has a link to the picture, and saved it where necessary via file_get_contents + changed the link to the picture in db

Answer 4

It's okay if each folder ends up with a few files. It is not the volume of pictures that matters here (if the disk allows), but the quantity. It happens that pictures are scattered automatically during creation in such subfolders. If one level of subfolders is not enough for a reasonable number of pictures in one folder, more are made. Then the advice of Ilya Beloborodov will come in handy for changing the folder structure.
rsync is better for copying in this situation. Especially if the project is active and pictures are removed and added.