How to make ladies parts from send to amazon?

Question

linux

Hello!
There is a directory with images, 20Gb in size.
Now the dump of the directory goes like this

/bin/tar -cf $DUMPFILES.tar $HOME/www // создать архив
/usr/bin/split -d -b 3G $DUMPFILES.tar $DUMPFILES.tar. // разбить архив на части по 3Гб
/bin/rm $DUMPFILES.tar // удалить исходный архив
/usr/bin/s3cmd -c /root/.s3cfg put $DUMPFILES.tar.* s3://backup/ // отправить архив на Амазон

The problem is that the archive on the disk requires another 20Gb, which is not available (SSD disk).
Is there a simple solution that allows you to create an archive in parts and send these parts to Amazon right away? That is, I typed files from a 3GB catalog, archived them, and sent them to Amazon.
Thanks for the help!

Answer 1

Try it as a stream, without saving to a file! (pass immediately after put means immediately take from the stream)
Can be compressed immediately
Well, or with such a mooooo command to beat, send and delete. (we make a pipe, hit it on a file, send the file and immediately delete it, send the next file, and delete it again)

/bin/tar -cz $HOME/www | /usr/bin/split -d -b 3G - $DUMPFILES.tar. --filter 's3cmd -c /root/.s3cfg put - s3://backup/$FILE'