Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 23 Zstd Open-Source Projects
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
-
p7zip
A new p7zip fork with additional codecs and improvements (forked from https://sourceforge.net/projects/sevenzip/ AND https://sourceforge.net/projects/p7zip/).
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
lizard
Lizard (formerly LZ5) is an efficient compressor with very fast decompression. It achieves compression ratio that is comparable to zip/zlib and zstd/brotli (at low and medium compression levels) at decompression speed of 1000 MB/s and faster. (by inikep)
-
ratarmount
Access large archives as a filesystem efficiently, e.g., TAR, RAR, ZIP, GZ, BZ2, XZ, ZSTD archives
-
-
zramd
Automatically setup swap on zram ✨ with optional systemd support, a simpler alternative to zram-generator and systemd-swap
-
wget-lua
Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
29. October 2021 At this point Jia Tan pops up, and the first thing we see from him is an innocuous patch to the xz repository, and while a lot of people believe he started out trying his luck with another library also known as libarchive, this is not the case, I would bet it’s more of a backup looking at the dates, being that there are a few days in between as shown in this commit.
This tutorial explains how to backup PostgreSQL database using pgBackRest and S3.
Project mention: DwarFS – The Deduplicating Warp-Speed Advanced Read-Only File System | news.ycombinator.com | 2024-04-11https://github.com/mhx/dwarfs/blob/main/doc/mkdwarfs.md#nils...
For a benchmark on a standard set: https://github.com/inikep/lzbench/blob/master/lzbench18_sort...
Project mention: Ratarmount: Access large archives as a filesystem efficiently | news.ycombinator.com | 2024-04-10
Project mention: Zstd Content-Encoding planned to ship with Chrome 123 | news.ycombinator.com | 2024-02-07I'm still unconvinced about this addition. And I don't even dislike Zstandard.
The main motivation seems to be that while Zstandard is worse than Brotli at the highest level, it's substantially faster than Brotli when data has to be compressed on the fly with a limited computation budget. That might be true, but I'm yet to see any concrete or even anecdotal evidence even in the issue tracker [1] while there exist some benchmarks where both Zstandard and Brotli are fast enough for the web usage even at lower levels [2].
According to their FAQ [3] Meta and Akamai have successfully used Zstandard in their internal network, but my gut feeling is that they never actually tried to optimize Brotli instead. In fact, Meta employs the main author of Zstandard so it would have been easier to tune Zstandard instead of Brotli. While Brotli has some fundamental difference from Zstandard (in particular Brotli doesn't use arithmetic-equivalent coding), no one has concretely demonstrated that difference would prevent Brotli from being fast enough for dynamic contents in my opinion.
[1] https://issues.chromium.org/issues/40196713
[2] https://github.com/powturbo/TurboBench/issues/43
[3] https://docs.google.com/document/d/14dbzMpsYPfkefAJos124uPrl...
Project mention: 📣 I want to debunk Reddit's claims, and talk about their unwillingness to work with developers, moderators, and the larger community, as well as say thank you for all the support | /r/apolloapp | 2023-06-19
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Zstd related posts
- Chrome Feature: ZSTD Content-Encoding
- WinRAR musste shady werden.
- Show HN: Gogosseract, a Go Lib for CGo-Free Tesseract OCR via Wazero
- 📣 I want to debunk Reddit's claims, and talk about their unwillingness to work with developers, moderators, and the larger community, as well as say thank you for all the support
- Encountered a non-utf8 character
- 28 years later, Windows finally supports RAR files
- My experience with btrfs so far
-
A note from our sponsor - InfluxDB
www.influxdata.com | 25 Apr 2024
Index
What are some of the best open-source Zstd projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | 7-Zip-zstd | 4,682 |
| 2 | compress | 4,489 |
| 3 | libarchive | 2,870 |
| 4 | pgBackRest | 2,194 |
| 5 | dwarfs | 1,860 |
| 6 | lzbench | 841 |
| 7 | p7zip | 735 |
| 8 | squashfs-tools | 708 |
| 9 | lizard | 633 |
| 10 | ratarmount | 628 |
| 11 | python-zstandard | 464 |
| 12 | gozstd | 412 |
| 13 | TurboBench | 310 |
| 14 | hpcc-js-wasm | 293 |
| 15 | zstd-rs | 227 |
| 16 | squashfs-tools-ng | 187 |
| 17 | zramd | 89 |
| 18 | wget-lua | 81 |
| 19 | zstd-seekable-format-go | 71 |
| 20 | zstd.cr | 39 |
| 21 | zreader | 30 |
| 22 | ZRA | 27 |
| 23 | destream | 12 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com