roaring-rs
zoekt
Our great sponsors
roaring-rs | zoekt | |
---|---|---|
12 | 5 | |
684 | 1,667 | |
1.8% | 1.3% | |
7.2 | 3.4 | |
13 days ago | 3 months ago | |
Rust | Go | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
roaring-rs
-
We’re the Meilisearch team! To celebrate v1.0 of our open-source search engine, Ask us Anything!
There are issues and pull requests but I advise you to look at the milli folder in the Meilisearch repository, it’s where all the logic is done. We extensively use RoaringBitmaps, heed the LMDB wrapper and grenad when indexing.
- Roaring-rs, better-compressed bitsets, is introducing faster multiple-bitmaps operations
-
Roaring-rs, better-compressed bitsets, is seeing the most important performance speed-up to date
On some benchmarks, we are faster but most of the time we aren't. We absolutely need to introduce benchmarks with the croaring-rs library and most of those performances gain could also be achieved with other methods to do multi-ops for example.
-
What’s everyone working on this week (9/2022)?
We tried to release the new version of roaring-rs, better compressed bitset in Rust, but found out that the core library simd module was blocking us. We now have to work on std::simd to release the blocking features.
-
Meilisearch, the Rust search engine, just raised $5M
Yeah, it can be attributed to using the roaring-rs library, but not just that, we have done so much to improve the search performances by reducing the number of set-operations we do.
-
Improving GitHub Code Search
Given the shoutouts to Burntsushi and Lemire this is almost certainly a bitmap trigram index based engine similar to https://github.com/google/zoekt
The index is likely based on Roaring bitmaps, presumably https://github.com/RoaringBitmap/roaring-rs in this case.
Nice architecture, exactly how I would have done it also.
- roaring-rs - What do you think about deprecating the set operation functions (intersect_with...) for the benefit of the std ops traits?
-
What's everyone working on this week (17/2021)?
I have worked on roaring-rs, a very fast library to do set operations like unions and intersections, and improved the four operations by using the standard ops traits.
-
What’s everyone working on this week (13/2021)?
I have implemented a better way of specifying ranges to be inserted or removed from a RoaringBitmap by using the RangeBounds trait. The roaring-rs library exposes fast data-structures to do set operations, like intersections and unions.
zoekt
- Zoekt – Fast trigram based code search
-
Improving GitHub Code Search
For the grepping aspect, https://github.com/google/zoekt is a powerful one-stop-shop. For the navigating, I don't know. SourceGraph maybe, but the linking is somewhat heuristic I assume, not compilation-graph powered. But maybe that changes or depends per language.
-
Facebook open sources Glean, its scalable code search and query engine
The latest index/search engine is https://github.com/google/zoekt
- A 5x reduction in RAM usage
What are some alternatives?
generic-array - Generic array types in Rust
codesearch - Fast, indexed regexp search over large file trees
array_tool - Array helpers for Rust's Vector and String types
Glean - System for collecting, deriving and working with facts about source code.
croaring-rs - Rust FFI wrapper for CRoaring
opengrok - OpenGrok is a fast and usable source code search and cross reference engine, written in Java
nym - Manipulate files en masse using patterns.
hoogle - Haskell API search engine
milli - Search engine library for Meilisearch ⚡️
chrono - Date and time library for Rust
base_custom - Rust implementation of custom numeric base conversion.
bar