lzbench
substrata
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
lzbench
-
Chrome Feature: ZSTD Content-Encoding
For a benchmark on a standard set: https://github.com/inikep/lzbench/blob/master/lzbench18_sort...
-
My experience with btrfs so far
Do not re-compress your file into level 3. The decompression speed is largely the same between level 3 and 8, so you just wasting CPU doing nothing and making your files larger. See the bottom of the README: https://github.com/inikep/lzbench
-
Rsyncing 20TB locally
You can crunch the numbers yourself with this: https://github.com/inikep/lzbench
-
Lizard – efficient compression with fast decompression
Note that a benchmark in the README refers to zstd 1.1.1 and brotli 0.5.2, which are very old (the current versions are zstd 1.5.2 and brotli 1.0.9). The same author maintains lzbench [1], which is more or less up-to-date.
[1] https://github.com/inikep/lzbench
- What scientists must know about hardware to write fast code
-
Zip-Ada development on LZMA compression
u/zertillon, maybe you could use lzbench, so you could compare it with a lot of other compression libraries. The problem is that it requires including the library in a single executable, so it might be more difficult to integrate than a C library (the benchmark is in C++).
-
Is there any site that lists the current SOTA for lossless compression?
Still updated: https://github.com/inikep/lzbench
-
will ZSTD impact L2ARC performance?
If you want to know the size a VM will compress to,. Zstd can be installed on any machine, so you can experiment easily. You can even run the benchmark https://github.com/inikep/lzbench
-
Save disk space for your games: BTRFS filesystem compression as alternative to CompactGUI on Linux
Are you sure about that? That's not what I see on https://github.com/inikep/lzbench and I tried to run that myself, although I have no idea which lzo to try so I went with what seemed the fastest...
substrata
-
Chrome Feature: ZSTD Content-Encoding
I implemented this in my server (https://substrata.info/). Works great. Results in smaller files than zlib/deflate.
-
Croquet: Live, network-transparent 3D gaming
Substrata is already open source (well, 99% open source): https://github.com/glaretechnologies/substrata
As far as scaling goes, fancy scaling solutions are currently in the 'future-problems' basket. Currently Substrata just uses a naive client-server solution with O(n^2) messaging where n is the number of connected clients - e.g. each message from a client is sent to all other clients.
-
Show HN: Substrata – An Open-Source Metaverse
Substrata is a metaverse that I have been working on for a few years, and have recently open-sourced.
It's written in C++ and OpenGL. You can try out pre-built binaries here: https://substrata.info/, or build it yourself from the source.
More details are available on the Github page: https://github.com/glaretechnologies/substrata and on the website: https://substrata.info/about_substrata
I'm happy to answer any questions about it!
- Substrata C++/OpenGL Metaverse open sourced
What are some alternatives?
7-Zip-zstd - 7-Zip with support for Brotli, Fast-LZMA2, Lizard, LZ4, LZ5 and Zstandard
hubs - Duck-themed multi-user virtual spaces in WebVR. Built with A-Frame.
CompactGUI - Transparently compress active games and programs using Windows 10/11 APIs [Moved to: https://github.com/IridiumIO/CompactGUI]
croquet-for-unity-guardians - Development of C4U version of Guardians
CompactGUI - Transparently compress active games and programs using Windows 10/11 APIs
thirdroom - Open, decentralised, immersive worlds built on Matrix
11Zip - Dead simple zipping / unzipping C++ Lib
qemu
zip-ada - Zip-Ada: a standalone, portable Ada library for .zip archives. Includes LZMA byte stream encoder & decoder pair.
ffi-overhead - comparing the c ffi (foreign function interface) overhead on various programming languages
SIMDCompressionAndIntersection - A C++ library to compress and intersect sorted lists of integers using SIMD instructions
lizard - Lizard (formerly LZ5) is an efficient compressor with very fast decompression. It achieves compression ratio that is comparable to zip/zlib and zstd/brotli (at low and medium compression levels) at decompression speed of 1000 MB/s and faster.