encoding
cuckoofilter
| encoding | cuckoofilter | |
|---|---|---|
| 1 | 1 | |
| 128 | 1,066 | |
| 0.0% | - | |
| 0.0 | 0.0 | |
| over 6 years ago | about 1 month ago | |
| Go | Go | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
encoding
-
q_compress 0.7: still has 35% higher compression ratio than .zstd.parquet for numerical sequences, now with delta encoding and 2x faster than before
I tried q_compress out on some of the datasets you linked and got these compressed sizes:
cuckoofilter
-
Looking for fast, space-efficient key-lookup
- a cuckoo filter for fast lookup. This has around a 3% false positive rate. There are other implementations however that have a much lower rate. You can store the filter in the database as well in a different bucket so you don't have to rebuild the filter on startup.
What are some alternatives?
gods - GoDS (Go Data Structures) - Sets, Lists, Stacks, Maps, Trees, Queues, and much more
hyperloglog - HyperLogLog with lots of sugar (Sparse, LogLog-Beta bias correction and TailCut space reduction) brought to you by Axiom
go-adaptive-radix-tree - Adaptive Radix Trees implemented in Go
golang-set - A simple, battle-tested and generic set type for the Go language. Trusted by Docker, 1Password, Ethereum and Hashicorp.
hilbert - Go package for mapping values to and from space-filling curves, such as Hilbert and Peano curves.
bloom - Bloom filters implemented in Go.
fsm - Finite State Machine for Go
conjungo - A small flexible merge library in go
gota - Gota: DataFrames and data wrangling in Go (Golang)
go-datastructures - A collection of useful, performant, and threadsafe Go datastructures.