Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> Everyone should be using zstd

Why?

 help



It's just the best general purpose compression algorithm, in terms of compression ratio to CPU used, for the vast majority of use cases

I'm not that fussed about CPU use.

https://github.com/mcmilk/7-Zip-zstd

By these charts, if I only need 5-10 megabytes per second of compression on a single core, LZMA2 wins significantly on ratio, and still decompresses at well over 100. If I'm doing a backup, or sending/receiving over my internet connection (which only has 2MB/s of upload), LZMA2 easily wins. If I need speed then zstd wins.


It's just this good.

On a more realistic note: few years back, I've added zstd compression to our log subsystem (hand written direct buffers, native code, in-process, java). For the same CPU utilization if provides twice dense compression compared to regular [-6] gzip (the topic in the title). Zstd is =much= faster on decompression as well, and it this case - unparalleledly better as it uses twice less disk.

zstd is 'silicon valley' (the tv show) - life imitates fiction, except entirely open source




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: