roaring-rs
milli
Our great sponsors
| roaring-rs | milli | |
|---|---|---|
| 12 | 8 | |
| 684 | 462 | |
| 1.8% | - | |
| 7.2 | 9.0 | |
| 12 days ago | about 1 year ago | |
| Rust | Rust | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
roaring-rs
-
We’re the Meilisearch team! To celebrate v1.0 of our open-source search engine, Ask us Anything!
There are issues and pull requests but I advise you to look at the milli folder in the Meilisearch repository, it’s where all the logic is done. We extensively use RoaringBitmaps, heed the LMDB wrapper and grenad when indexing.
- Roaring-rs, better-compressed bitsets, is introducing faster multiple-bitmaps operations
-
Roaring-rs, better-compressed bitsets, is seeing the most important performance speed-up to date
On some benchmarks, we are faster but most of the time we aren't. We absolutely need to introduce benchmarks with the croaring-rs library and most of those performances gain could also be achieved with other methods to do multi-ops for example.
-
What’s everyone working on this week (9/2022)?
We tried to release the new version of roaring-rs, better compressed bitset in Rust, but found out that the core library simd module was blocking us. We now have to work on std::simd to release the blocking features.
-
Meilisearch, the Rust search engine, just raised $5M
Yeah, it can be attributed to using the roaring-rs library, but not just that, we have done so much to improve the search performances by reducing the number of set-operations we do.
-
Improving GitHub Code Search
Given the shoutouts to Burntsushi and Lemire this is almost certainly a bitmap trigram index based engine similar to https://github.com/google/zoekt
The index is likely based on Roaring bitmaps, presumably https://github.com/RoaringBitmap/roaring-rs in this case.
Nice architecture, exactly how I would have done it also.
- roaring-rs - What do you think about deprecating the set operation functions (intersect_with...) for the benefit of the std ops traits?
-
What's everyone working on this week (17/2021)?
I have worked on roaring-rs, a very fast library to do set operations like unions and intersections, and improved the four operations by using the standard ops traits.
-
What’s everyone working on this week (13/2021)?
I have implemented a better way of specifying ranges to be inserted or removed from a RoaringBitmap by using the RangeBounds trait. The roaring-rs library exposes fast data-structures to do set operations, like intersections and unions.
milli
-
Proteomics search engine written in Rust
Is this a posting list? There is a lot of bioinformatics in this post, but if I squint, some of the problems do look like general information retrieval problems. Even the discussion of ordering the arrays by mass sounds like search relevance scores and makes me wonder if it makes sense to try to get something off the shelf like meillisearch/milli or tantavy to support this use case.
-
Zettelkasten Options
I'm currently not using any tool, although I am playing around with binding Milli and the most up-to-date Mentat fork to emacs with emacs-module-rs.
-
Meilisearch, the Rust search engine, just raised $5M
Yeah, we have already done that, the internal engine is called milli and could even be published on crates.io one day! The issue is with the design of the storage system itself, we use LMDB right now but maybe we can find another way to index faster and to be more oriented to distributed systems.
-
MeiliSearch: A Minimalist Full-Text Search Engine
They have another prototype engine with more advanced features and performance too.
https://github.com/meilisearch/milli
-
MeiliSearch v0.21, the long-awaited update of our search engine in Rust is out!
You can look at the milli repository this is the library that we use and work on. MeiliSearch is the HTTP actix-web based server that serves the milli indices.
- MeiliSearch needs your help, an undefined behavior can be the cause of a strange bug
-
What's everyone working on this week (17/2021)?
This library is the main bottleneck of the new MeiliSearch search engine. We will soon release a beta version, keep watching!
-
What’s everyone working on this week (16/2021)?
Working on the new MeiliSearch engine, reworked from scratch! There already is excellent external contributions 🎉
What are some alternatives?
generic-array - Generic array types in Rust
Typesense - Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuzzy Search Engine for building delightful search experiences
array_tool - Array helpers for Rust's Vector and String types
tantivy - Tantivy is a full-text search engine library inspired by Apache Lucene and written in Rust
croaring-rs - Rust FFI wrapper for CRoaring
pgroonga - PGroonga is a PostgreSQL extension to use Groonga as index. PGroonga makes PostgreSQL fast full text search platform for all languages!
nym - Manipulate files en masse using patterns.
vespa - AI + Data, online. https://vespa.ai
base_custom - Rust implementation of custom numeric base conversion.
heed - A fully typed LMDB wrapper with minimum overhead 🐦
nym - Nym provides strong network-level privacy against sophisticated end-to-end attackers, and anonymous transactions using blinded, re-randomizable, decentralized credentials.
prost - PROST! a Protocol Buffers implementation for the Rust Language