Top 23 search-engine Open-Source Projects
-
AFAIK the rollup API is currently being rewritten in order to integrate it into the index lifecycle management (ILM). See also https://github.com/elastic/elasticsearch/issues/42720 . Therefore in future rollup indexes will also have a lifecycle and be deleted after some time.
-
Meilisearch : Algolia and Elasticsearch search engine alternative.
-
Scout APM
Scout APM - Leading-edge performance monitoring starting at $39/month. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.
-
https://www.freecodecamp.org/ https://learn-anything.xyz/ https://try.github.io/
-
sonic
🦔 Fast, lightweight & schema-less search backend. An alternative to Elasticsearch that runs on a few MBs of RAM.
Sonic : Lightweight Elasticsearch alternative.
-
Project mention: We need better open source e-mail clients! | reddit.com/r/privacytoolsIO | 2021-02-02
Mailpile.is comes to mind. Their Twitter account is inactive since 2018, but they did fix some things on Github in November of 2020: https://github.com/mailpile/Mailpile/
-
In case you want to search your GraphQL layer using a search engine like FlexSearch, you might want to have a look at this plugin!
-
-
Project mention: Firebase recommending you use Algolia for search is like McDonald's recommending you go to Burger King for fries | reddit.com/r/Firebase | 2021-05-10
-
What we store on S3 is a regular tantivy index and another tiny data structure that we call "turbo index", which makes queries faster on object storages. For this demo, the tantivy indexes are fairly large and we issue HTTP Range requests against them.
-
Project mention: Implementing auto-complete functionality in Elasticsearch - Part I: Prefix queries | dev.to | 2021-04-17
A technology that makes it easy to implement such features is Elasticsearch - a search and analytics engine built on top of Apache Lucene library. Elasticsearch has distributed, multi-tenant architecture with built-in routing and re-balancing, making it easy to scale. It's a widely used data store for storing, searching, and analyzing large volumes of data.
-
Project mention: AWS releases forked Elasticsearch code. Announces new name: OpenSearc | news.ycombinator.com | 2021-04-12
-
magnetissimo
Web application that indexes all popular torrent sites, and saves it to the local database.
-
I'm using magnetico (https://github.com/boramalper/magnetico), a selfhosted bittorrent DHT scraper. After a few months of running I now have a little bit under 1M magnets in a ~3G database. SQLite is useful not just because I can query it with the full power of a relational database, but because I'm using its FTS capability for searching.
If I had to install a typical database or some search engine I would never have used it. It is more than enough for what I'm using it for.
-
Project mention: Searching for users with Laravel Scout and TNTSearch | reddit.com/r/laravel | 2021-03-12
While we're at it, would it be possible to store the index in the existing database instead of SQLite ? Wouldn't that allow for index syncing reliability (I hear there are file corruption problems ) ? And reducing the number of processes (no index queue) ?
-
-
-
Project mention: Full-text-search in PDFs over several folders - ideas? | reddit.com/r/sysadmin | 2021-04-19
Ambar - Document Search Engine · An open-source document search engine with automated crawling, OCR, tagging and instant full-text search
-
-
Search Plugins Guide for Qbittorrent
-
-
Project mention: What is a program that you use that's uncommon but essential for you? | reddit.com/r/archlinux | 2021-05-04
its amateurish but it works, probably fsearch is a better option to use for most people.
-
Project mention: used greenfoot b4 in school but now i want to study python (im a first timer|). | reddit.com/r/learnprogramming | 2021-05-07
You could try looking through this list for something.
-
Project mention: proposal: slices: new package to provide generic slice functions · Issue #45955 | reddit.com/r/golang | 2021-05-05
It's a Vector Database, the gif in the README gives a rough example, here's also a video where my colleague demos some semantic search queries.
Index
What are some of the best open-source search-engine projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | Elasticsearch | 54,745 |
| 2 | MeiliSearch | 13,640 |
| 3 | learn-anything | 12,943 |
| 4 | sonic | 11,234 |
| 5 | Mailpile | 8,392 |
| 6 | flexsearch | 6,969 |
| 7 | riot | 5,732 |
| 8 | Typesense | 5,457 |
| 9 | tantivy | 4,743 |
| 10 | Apache Solr | 4,143 |
| 11 | Toshi | 3,155 |
| 12 | magnetissimo | 2,494 |
| 13 | Magnetico | 2,488 |
| 14 | TNTSearch | 2,406 |
| 15 | OpenSearch | 2,182 |
| 16 | whoogle-search | 1,731 |
| 17 | Ambar | 1,729 |
| 18 | tinysearch | 1,518 |
| 19 | search-plugins | 1,510 |
| 20 | bayard | 1,472 |
| 21 | fsearch | 1,402 |
| 22 | 100ProjectsOfCode | 1,265 |
| 23 | Weaviate | 1,190 |