Open-source projects categorized as search-engine | Edit details

Top 23 search-engine Open-Source Projects

  • GitHub repo Elasticsearch

    Free and Open, Distributed, RESTful Search Engine

    Project mention: Rolling over rolledup index | reddit.com/r/elasticsearch | 2021-04-27

    AFAIK the rollup API is currently being rewritten in order to integrate it into the index lifecycle management (ILM). See also https://github.com/elastic/elasticsearch/issues/42720 . Therefore in future rollup indexes will also have a lifecycle and be deleted after some time.

  • GitHub repo MeiliSearch

    Lightning Fast, Ultra Relevant, and Typo-Tolerant Search Engine

    Project mention: Why you should code in Rust in 2021 | dev.to | 2021-05-06

    Meilisearch : Algolia and Elasticsearch search engine alternative.

  • GitHub repo learn-anything

    Organize world's knowledge, explore connections and curate learning paths

    Project mention: Returning to education? | reddit.com/r/CasualUK | 2021-03-29

    https://www.freecodecamp.org/ https://learn-anything.xyz/ https://try.github.io/

  • GitHub repo sonic

    🦔 Fast, lightweight & schema-less search backend. An alternative to Elasticsearch that runs on a few MBs of RAM.

    Project mention: Why you should code in Rust in 2021 | dev.to | 2021-05-06

    Sonic : Lightweight Elasticsearch alternative.

  • GitHub repo Mailpile

    A free & open modern, fast email client with user-friendly encryption and privacy features

    Project mention: We need better open source e-mail clients! | reddit.com/r/privacytoolsIO | 2021-02-02

    Mailpile.is comes to mind. Their Twitter account is inactive since 2018, but they did fix some things on Github in November of 2020: https://github.com/mailpile/Mailpile/

  • GitHub repo flexsearch

    Next-Generation full text search library for Browser and Node.js

    Project mention: Top 50 Gatsby plugins you're going to love 🔥👨‍💻 | dev.to | 2021-01-14

    In case you want to search your GraphQL layer using a search engine like FlexSearch, you might want to have a look at this plugin!

  • GitHub repo riot

    Go Open Source, Distributed, Simple and efficient Search Engine (by go-ego)

  • GitHub repo Typesense

    Fast, typo tolerant, fuzzy search engine for building delightful search experiences ⚡ 🔍

    Project mention: Firebase recommending you use Algolia for search is like McDonald's recommending you go to Burger King for fries | reddit.com/r/Firebase | 2021-05-10
  • GitHub repo tantivy

    Tantivy is a full-text search engine library inspired by Apache Lucene and written in Rust

    Project mention: Search 1B pages on AWS S3 for | news.ycombinator.com | 2021-05-07

    What we store on S3 is a regular tantivy index and another tiny data structure that we call "turbo index", which makes queries faster on object storages. For this demo, the tantivy indexes are fairly large and we issue HTTP Range requests against them.


  • GitHub repo Apache Solr

    Apache Lucene and Solr open-source search software

    Project mention: Implementing auto-complete functionality in Elasticsearch - Part I: Prefix queries | dev.to | 2021-04-17

    A technology that makes it easy to implement such features is Elasticsearch - a search and analytics engine built on top of Apache Lucene library. Elasticsearch has distributed, multi-tenant architecture with built-in routing and re-balancing, making it easy to scale. It's a widely used data store for storing, searching, and analyzing large volumes of data.

  • GitHub repo Toshi

    A full-text search engine in rust

    Project mention: AWS releases forked Elasticsearch code. Announces new name: OpenSearc | news.ycombinator.com | 2021-04-12
  • GitHub repo magnetissimo

    Web application that indexes all popular torrent sites, and saves it to the local database.

  • GitHub repo Magnetico

    Autonomous (self-hosted) BitTorrent DHT search engine suite.

    Project mention: Cross-Database Queries in SQLite | news.ycombinator.com | 2021-02-21

    I'm using magnetico (https://github.com/boramalper/magnetico), a selfhosted bittorrent DHT scraper. After a few months of running I now have a little bit under 1M magnets in a ~3G database. SQLite is useful not just because I can query it with the full power of a relational database, but because I'm using its FTS capability for searching.

    If I had to install a typical database or some search engine I would never have used it. It is more than enough for what I'm using it for.

  • GitHub repo TNTSearch

    A fully featured full text search engine written in PHP

    Project mention: Searching for users with Laravel Scout and TNTSearch | reddit.com/r/laravel | 2021-03-12

    While we're at it, would it be possible to store the index in the existing database instead of SQLite ? Wouldn't that allow for index syncing reliability (I hear there are file corruption problems ) ? And reducing the number of processes (no index queue) ?

  • GitHub repo OpenSearch

    Open source distributed and RESTful search engine. (by opensearch-project)

    Project mention: AWS Rilis Fork Sumber Terbuka Elasticsearch, OpenSearch | dev.to | 2021-04-14
  • GitHub repo Ambar

    :mag: Ambar: Document Search Engine

    Project mention: Full-text-search in PDFs over several folders - ideas? | reddit.com/r/sysadmin | 2021-04-19

    Ambar - Document Search Engine · An open-source document search engine with automated crawling, OCR, tagging and instant full-text search

  • GitHub repo tinysearch

    🔍 Tiny, full-text search engine for static websites built with Rust and Wasm

    Project mention: tinysearch | reddit.com/r/devopsish | 2021-02-20
  • GitHub repo search-plugins

    Search plugins for the search feature

    Project mention: Problem with searching torrent sites | reddit.com/r/torrents | 2021-05-10

    Search Plugins Guide for Qbittorrent

  • GitHub repo bayard

    A full-text search and indexing server written in Rust.

  • GitHub repo fsearch

    A fast file search utility for Unix-like systems based on GTK+3

    Project mention: What is a program that you use that's uncommon but essential for you? | reddit.com/r/archlinux | 2021-05-04

    its amateurish but it works, probably fsearch is a better option to use for most people.

  • GitHub repo 100ProjectsOfCode

    A list of practical knowledge-building projects.

    Project mention: used greenfoot b4 in school but now i want to study python (im a first timer|). | reddit.com/r/learnprogramming | 2021-05-07

    You could try looking through this list for something.

  • GitHub repo Weaviate

    Weaviate is a cloud-native, modular, real-time vector search engine

    Project mention: proposal: slices: new package to provide generic slice functions · Issue #45955 | reddit.com/r/golang | 2021-05-05

    It's a Vector Database, the gif in the README gives a rough example, here's also a video where my colleague demos some semantic search queries.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2021-05-10.


What are some of the best open-source search-engine projects? This list will help you:

Project Stars
1 Elasticsearch 54,745
2 MeiliSearch 13,640
3 learn-anything 12,943
4 sonic 11,234
5 Mailpile 8,392
6 flexsearch 6,969
7 riot 5,732
8 Typesense 5,457
9 tantivy 4,743
10 Apache Solr 4,143
11 Toshi 3,155
12 magnetissimo 2,494
13 Magnetico 2,488
14 TNTSearch 2,406
15 OpenSearch 2,182
16 whoogle-search 1,731
17 Ambar 1,729
18 tinysearch 1,518
19 search-plugins 1,510
20 bayard 1,472
21 fsearch 1,402
22 100ProjectsOfCode 1,265
23 Weaviate 1,190