ans-large-alphabet
encoding
ans-large-alphabet | encoding | |
---|---|---|
1 | 1 | |
4 | 128 | |
- | 0.0% | |
10.0 | 0.0 | |
about 4 years ago | over 6 years ago | |
C++ | Go | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ans-large-alphabet
-
q_compress 0.7: still has 35% higher compression ratio than .zstd.parquet for numerical sequences, now with delta encoding and 2x faster than before
I see the usage field of your algorithm q_compress more in large alphabet integer compression (like lz77 offsets). If you have time, you can generate and test your algorithm with this practical dataset.
encoding
-
q_compress 0.7: still has 35% higher compression ratio than .zstd.parquet for numerical sequences, now with delta encoding and 2x faster than before
I tried q_compress out on some of the datasets you linked and got these compressed sizes:
What are some alternatives?
TurboPFor - Fastest Integer Compression
gods - GoDS (Go Data Structures) - Sets, Lists, Stacks, Maps, Trees, Queues, and much more
pcodec - Lossless compressor and decompressor for numerical data using quantiles
go-adaptive-radix-tree - Adaptive Radix Trees implemented in Go
gdal - GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats.
hilbert - Go package for mapping values to and from space-filling curves, such as Hilbert and Peano curves.
x3-rust - X3 Lossless Audio Compression for Rust
fsm - Finite State Machine for Go
cuckoofilter - Cuckoo Filter: Practically Better Than Bloom
conjungo - A small flexible merge library in go
gota - Gota: DataFrames and data wrangling in Go (Golang)
algorithms - CLRS study. Codes are written with golang.