RoaringBitmap
A better compressed bitset in Java: used by Apache Spark, Netflix Atlas, Apache Pinot, Tablesaw, and many others (by RoaringBitmap)
CQEngine
Ultra-fast SQL-like queries on Java collections (by npgall)
| RoaringBitmap | CQEngine | |
|---|---|---|
| 24 | 6 | |
| 3,388 | 1,677 | |
| 0.8% | - | |
| 8.5 | 0.0 | |
| 9 days ago | 4 months ago | |
| Java | Java | |
| Apache License 2.0 | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
RoaringBitmap
Posts with mentions or reviews of RoaringBitmap.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-07-18.
-
Iterating over Bit Sets Quickly
I was recently reading about Roaring https://roaringbitmap.org/ which is a highly optimized compressed bitset implementation. I reccomend reading about it if you are interested in this sort of thing. The talk at https://roaringbitmap.org/talks/ is especially good.
- Roaring Bitmaps
- Roaring bitmaps are compressed bitmaps, can be 100x faster
-
What feature would you like to remove in C++26?
However, I would love compressed (not just packed) bitsets too, which is something different to me. I would make it another class with a similar interface, based on something like roaring. It doesn't need to be in the standard, but it would be nice if the API was a such that one could easily swap implementations.
-
Jaccard Index
As an aside if you find yourself having to compute them on the fly, know that the Roaring Bitmaps libraries is the way to go [1]. The bitmaps are compressed, and can be streamed directly into SIMD computations (batching XORs and popcnts 256 bits wide!). The Jaccard index is just intersection_len / union_len [2] away
[1] https://roaringbitmap.org/
[2] https://roaringbitmap.readthedocs.io/en/latest/#roaringbitma...
-
Looking for fast, space-efficient key-lookup
Use a two stage approach, with a bloom/cuckoo filter stored as a https://roaringbitmap.org/ in memory. Then a secondary key/value store on disk (bolt or anything else).
-
BitSet Vs BigInteger
As an aside, if you're dealing with large bit sets, you might also want to evaluate Roaring Bitmaps.
-
Negative Incentives in Academic Research
Sidetracking a bit the conversation. What a coincidence that the author (Lemire) is also represented on Today's #1 "Ask HN: What are some cool but obscure data structures you know about?" as he is the main contributor of RoaringBitmap https://github.com/RoaringBitmap/RoaringBitmap and one of the main authors of the data structure.
- Ask HN: What are some 'cool' but obscure data structures you know about?
- Roaring bitmaps: A better compressed bitset
CQEngine
Posts with mentions or reviews of CQEngine.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-05-18.
-
What is the weirdest or most interesting piece of code you ever had to write?
Wrote the code to convert CQEngineCQEngine queries into Solr search queries.
-
Looking for: library to turn SQL (or abstracted) to code & execute against custom backend (slice of structs)
It seems that you're looking for something like https://github.com/npgall/cqengine but unfortunately I'm not aware of any equivalent in Go. LINQ is similar. I'd probably try searching for "LINQ in go" or something like that.
-
Evaluating Range Predicates over Java collections
I wonder if there's a huge difference in efficiency between RoaringBitmap and CQEngine. I used CQEngine a few years back and it turned out really great. Never tried RoaringBitmap, though.
- CQEngine for Java Tutorials/ Guides / Books?
- Ideal Datastructure for Multiple Keys mapping to Multiple Values?
- Early stage draft: Functional transformation of immutable objects
What are some alternatives?
When comparing RoaringBitmap and CQEngine you can also consider the following projects:
HyperMinHash-java - Union, intersection, and set cardinality in loglog space
Lanterna - Java library for creating text-based GUIs
lucene - Apache Lucene open-source search software
Modern Java - A Guide to Java 8 - Modern Java - A Guide to Java 8
Primes - Prime Number Projects in C#/C++/Python
OpenRefine - OpenRefine is a free, open source power tool for working with messy data and improving it
Feign - Feign makes writing java http clients easier
Design Patterns - Design patterns implemented in Java
maven-compiler-plugin - Apache Maven Compiler Plugin
jabba - (cross-platform) Java Version Manager
alexandria - Full text search engine powering Alexandria.org - the open search engine.
Smooks - Extensible data integration Java framework for building XML and non-XML fragment-based applications
RoaringBitmap vs HyperMinHash-java
CQEngine vs Lanterna
RoaringBitmap vs lucene
CQEngine vs Modern Java - A Guide to Java 8
RoaringBitmap vs Primes
CQEngine vs OpenRefine
RoaringBitmap vs Feign
CQEngine vs Design Patterns
RoaringBitmap vs maven-compiler-plugin
CQEngine vs jabba
RoaringBitmap vs alexandria
CQEngine vs Smooks