DAR VS LZ4

Dar is the only tool I know of that supports incremental backups to untrusted remote storage. All the remote sees are giant encrypted blobs. Source: 12 months ago

DAR is a linux tool that does incremental updates after a snapshot: http://dar.linux.free.fr/. Source: about 1 year ago

I have also used dar ( http://dar.linux.free.fr/ ) instead of tar for recent disk archives. Source: over 1 year ago

Dar - Like tar, but can do incremental and differential backups with rsync-style binary diffs, only archiving what's changed (and without trusting mtimes like tar --newer does). Source: over 1 year ago

Write compressed, encrypted, sliced archives of the lvm snapshot to HDDs mounted via USB using dar Dar will pause to change HDD every few TiB. Source: almost 2 years ago

LZ4[1] intentionally compresses worse than Deflate—where Deflate is LZ77 with Huffman, LZ4 is just LZ77. It’s “we’re saturating Gigabit Ethernet and have some compute left over” compression, not “we need to squeeze our backups as much as possible” compression. If filtering+LZ4 does better than Deflate, then you’ve chosen the filter well. Curiously, for some kinds of binary serialization a good filter in... - Source: Hacker News / over 1 year ago

It doesn't destroy performance for the simple reason that nowadays memory access has higher latency than pure compute. If you need to use compute to produce some data to be stored in memory, your overall throughput could very well be faster than without compression. There have been a large amount of innovation on fast compression in recent years. Traditional compression tools like gzip or xz are geared towards... - Source: Hacker News / over 1 year ago

Just looked it up [1] > LZ4 is lossless compression algorithm, providing compression speed > 500 MB/s per core (>0.15 Bytes/cycle). It features an extremely fast decoder, with speed in multiple GB/s per core (~1 Byte/cycle). [1]: https://lz4.github.io/lz4/. - Source: Hacker News / over 1 year ago

Planet: weekly As you can see the planet file has the LZ4 extension, this is a compression-algorithm which a very good speed/size ratio and reduces the size with about 20-25 GB. It. Source: almost 2 years ago

I found this interesting dataLZ4 HC (r101) -9) increases transfer speed by about 22%, while only losing a 10% performance on decompression. That's a 12% performance increase overall, not bad! Source: about 2 years ago