Top 23 search-engine Open-Source Projects
Free and Open, Distributed, RESTful Search EngineProject mention: Rolling over rolledup index | reddit.com/r/elasticsearch | 2021-04-27
AFAIK the rollup API is currently being rewritten in order to integrate it into the index lifecycle management (ILM). See also https://github.com/elastic/elasticsearch/issues/42720 . Therefore in future rollup indexes will also have a lifecycle and be deleted after some time.
Lightning Fast, Ultra Relevant, and Typo-Tolerant Search EngineProject mention: Why you should code in Rust in 2021 | dev.to | 2021-05-06
Meilisearch : Algolia and Elasticsearch search engine alternative.
Scout APM - Leading-edge performance monitoring starting at $39/month. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.
Organize world's knowledge, explore connections and curate learning pathsProject mention: Returning to education? | reddit.com/r/CasualUK | 2021-03-29
https://www.freecodecamp.org/ https://learn-anything.xyz/ https://try.github.io/
🦔 Fast, lightweight & schema-less search backend. An alternative to Elasticsearch that runs on a few MBs of RAM.Project mention: Why you should code in Rust in 2021 | dev.to | 2021-05-06
Sonic : Lightweight Elasticsearch alternative.
A free & open modern, fast email client with user-friendly encryption and privacy featuresProject mention: We need better open source e-mail clients! | reddit.com/r/privacytoolsIO | 2021-02-02
Mailpile.is comes to mind. Their Twitter account is inactive since 2018, but they did fix some things on Github in November of 2020: https://github.com/mailpile/Mailpile/
Next-Generation full text search library for Browser and Node.jsProject mention: Top 50 Gatsby plugins you're going to love 🔥👨💻 | dev.to | 2021-01-14
In case you want to search your GraphQL layer using a search engine like FlexSearch, you might want to have a look at this plugin!
Go Open Source, Distributed, Simple and efficient Search Engine (by go-ego)
Fast, typo tolerant, fuzzy search engine for building delightful search experiences ⚡ 🔍Project mention: Firebase recommending you use Algolia for search is like McDonald's recommending you go to Burger King for fries | reddit.com/r/Firebase | 2021-05-10
Tantivy is a full-text search engine library inspired by Apache Lucene and written in RustProject mention: Search 1B pages on AWS S3 for | news.ycombinator.com | 2021-05-07
What we store on S3 is a regular tantivy index and another tiny data structure that we call "turbo index", which makes queries faster on object storages. For this demo, the tantivy indexes are fairly large and we issue HTTP Range requests against them.
Apache Lucene and Solr open-source search softwareProject mention: Implementing auto-complete functionality in Elasticsearch - Part I: Prefix queries | dev.to | 2021-04-17
A technology that makes it easy to implement such features is Elasticsearch - a search and analytics engine built on top of Apache Lucene library. Elasticsearch has distributed, multi-tenant architecture with built-in routing and re-balancing, making it easy to scale. It's a widely used data store for storing, searching, and analyzing large volumes of data.
A full-text search engine in rustProject mention: AWS releases forked Elasticsearch code. Announces new name: OpenSearc | news.ycombinator.com | 2021-04-12
Web application that indexes all popular torrent sites, and saves it to the local database.
Autonomous (self-hosted) BitTorrent DHT search engine suite.Project mention: Cross-Database Queries in SQLite | news.ycombinator.com | 2021-02-21
I'm using magnetico (https://github.com/boramalper/magnetico), a selfhosted bittorrent DHT scraper. After a few months of running I now have a little bit under 1M magnets in a ~3G database. SQLite is useful not just because I can query it with the full power of a relational database, but because I'm using its FTS capability for searching.
If I had to install a typical database or some search engine I would never have used it. It is more than enough for what I'm using it for.
A fully featured full text search engine written in PHPProject mention: Searching for users with Laravel Scout and TNTSearch | reddit.com/r/laravel | 2021-03-12
While we're at it, would it be possible to store the index in the existing database instead of SQLite ? Wouldn't that allow for index syncing reliability (I hear there are file corruption problems ) ? And reducing the number of processes (no index queue) ?
Open source distributed and RESTful search engine. (by opensearch-project)Project mention: AWS Rilis Fork Sumber Terbuka Elasticsearch, OpenSearch | dev.to | 2021-04-14
A self-hosted, ad-free, privacy-respecting metasearch engineProject mention: What do you think about Whoogle? | reddit.com/r/thehatedone | 2021-05-01
:mag: Ambar: Document Search EngineProject mention: Full-text-search in PDFs over several folders - ideas? | reddit.com/r/sysadmin | 2021-04-19
Ambar - Document Search Engine · An open-source document search engine with automated crawling, OCR, tagging and instant full-text search
🔍 Tiny, full-text search engine for static websites built with Rust and WasmProject mention: tinysearch | reddit.com/r/devopsish | 2021-02-20
Search plugins for the search featureProject mention: Problem with searching torrent sites | reddit.com/r/torrents | 2021-05-10
Search Plugins Guide for Qbittorrent
A full-text search and indexing server written in Rust.
A fast file search utility for Unix-like systems based on GTK+3Project mention: What is a program that you use that's uncommon but essential for you? | reddit.com/r/archlinux | 2021-05-04
its amateurish but it works, probably fsearch is a better option to use for most people.
A list of practical knowledge-building projects.Project mention: used greenfoot b4 in school but now i want to study python (im a first timer|). | reddit.com/r/learnprogramming | 2021-05-07
You could try looking through this list for something.
Weaviate is a cloud-native, modular, real-time vector search engineProject mention: proposal: slices: new package to provide generic slice functions · Issue #45955 | reddit.com/r/golang | 2021-05-05
It's a Vector Database, the gif in the README gives a rough example, here's also a video where my colleague demos some semantic search queries.
What are some of the best open-source search-engine projects? This list will help you: