snowflake
roaring
snowflake | roaring | |
---|---|---|
1 | 5 | |
2,863 | 2,360 | |
- | 1.4% | |
0.0 | 7.7 | |
8 months ago | 9 days ago | |
Go | Go | |
BSD 2-clause "Simplified" License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
snowflake
-
Bit shifting blew my mind
It doesn't come up very often. There is an id generation library I use github.com/bwmarrin/snowflake that makes pretty good use of bit shifting. Each id is split into 3 parts, a timestamp, a node id, and a sequence number. The idea is that each server has a node id. Each node can make 4096 ids every millisecond for about 70 years. It works by doing the following
roaring
-
I have some questions about defining a series of bits in Golang
For (3), and if you’re interested in checking if specific bits are set or not, take a look at https://github.com/bits-and-blooms/bitset and https://github.com/RoaringBitmap/roaring.
- Bitmasks - how and why to use?
-
Skipfilter
Each topic has a roaring bitmap. Each bit corresponds to a subscriber in the skip list. For each topic, head and tail cursors are also maintained to ensure that newly added subscriptions are always tested and deleted subscriptions are always evicted. Roaring bitmaps are compressed and discontinuous so memory usage again remains bounded as subscribers come and go.
-
Bit shifting blew my mind
Definitely take a look at a roaring bitmap. https://github.com/RoaringBitmap/roaring
-
Protocol buffers database, a Key-Value database on the wire
Roaring bitmaps + btrees are a rock solid indexing approach. Alternatively, bleve has a lot out of the box but that's introducing a new datastore, basically.
What are some alternatives?
go-snowflake - ❄ An Lock Free ID Generator for Golang based on Snowflake Algorithm (Twitter announced).
skiplist - skiplist for golang
squashfs - A library to interact with Squashfs archives. Currently only has support for reading, but writing archives will probably come eventually.
boomfilters - Probabilistic data structures for processing continuous, unbounded streams.
traefik - The Cloud Native Application Proxy
bitset - Go package implementing bitsets
terraform-provider-snowflake - Terraform provider for managing Snowflake accounts
bit - Bitset data structure
gosnowflake - Go Snowflake Driver
hyperloglog - HyperLogLog with lots of sugar (Sparse, LogLog-Beta bias correction and TailCut space reduction) brought to you by Axiom
golang-set - A simple, battle-tested and generic set type for the Go language. Trusted by Docker, 1Password, Ethereum and Hashicorp.
Bloomfilter