roaring
snowflake
| roaring | snowflake | |
|---|---|---|
| 5 | 1 | |
| 2,349 | 2,847 | |
| 0.9% | - | |
| 7.6 | 0.0 | |
| 14 days ago | 8 months ago | |
| Go | Go | |
| Apache License 2.0 | BSD 2-clause "Simplified" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
roaring
-
I have some questions about defining a series of bits in Golang
For (3), and if you’re interested in checking if specific bits are set or not, take a look at https://github.com/bits-and-blooms/bitset and https://github.com/RoaringBitmap/roaring.
- Bitmasks - how and why to use?
-
Skipfilter
Each topic has a roaring bitmap. Each bit corresponds to a subscriber in the skip list. For each topic, head and tail cursors are also maintained to ensure that newly added subscriptions are always tested and deleted subscriptions are always evicted. Roaring bitmaps are compressed and discontinuous so memory usage again remains bounded as subscribers come and go.
-
Bit shifting blew my mind
Definitely take a look at a roaring bitmap. https://github.com/RoaringBitmap/roaring
-
Protocol buffers database, a Key-Value database on the wire
Roaring bitmaps + btrees are a rock solid indexing approach. Alternatively, bleve has a lot out of the box but that's introducing a new datastore, basically.
snowflake
-
Bit shifting blew my mind
It doesn't come up very often. There is an id generation library I use github.com/bwmarrin/snowflake that makes pretty good use of bit shifting. Each id is split into 3 parts, a timestamp, a node id, and a sequence number. The idea is that each server has a node id. Each node can make 4096 ids every millisecond for about 70 years. It works by doing the following
What are some alternatives?
skiplist - skiplist for golang
go-snowflake - ❄ An Lock Free ID Generator for Golang based on Snowflake Algorithm (Twitter announced).
boomfilters - Probabilistic data structures for processing continuous, unbounded streams.
squashfs - A library to interact with Squashfs archives. Currently only has support for reading, but writing archives will probably come eventually.
bit - Bitset data structure
traefik - The Cloud Native Application Proxy
bitset - Go package implementing bitsets
terraform-provider-snowflake - Terraform provider for managing Snowflake accounts
hyperloglog - HyperLogLog with lots of sugar (Sparse, LogLog-Beta bias correction and TailCut space reduction) brought to you by Axiom
gosnowflake - Go Snowflake Driver
golang-set - A simple, battle-tested and generic set type for the Go language. Trusted by Docker, 1Password, Ethereum and Hashicorp.
gostl - Data structure and algorithm library for go, designed to provide functions similar to C++ STL