Open-source projects categorized as Database | Edit details
Related topics: #SQL #Postgresql #MySQL #ORM #Sqlite

Top 23 Database Open-Source Projects

  • GitHub repo prometheus

    The Prometheus monitoring system and time series database.

    Project mention: Implementing Istio in a Kubernetes cluster | | 2021-10-25

    For simplicity and example purposes, the following section will use the demo manifests for deploying Kiali, Jaeger, Prometheus, and Grafana.

  • GitHub repo etcd

    Distributed reliable key-value store for the most critical data of a distributed system

    Project mention: Package Management Nightmare | | 2021-10-12

    They have an open issue for it and looks like no blockers, and a PR bumping the otel version, so it looks like it's moving.

  • Scout APM

    Scout APM: A developer's best friend. Try free for 14-days. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.

  • GitHub repo tidb

    TiDB is an open source distributed HTAP database compatible with the MySQL protocol

    Project mention: Question regarding computing industry | | 2021-06-20

    My knowledge is still quite limited because I never worked on the internals of distributed databases (I've only used and deployed them as an intern) but I have taken Advanced Databases CZ4031 in NTU and Parallel and Distributed Algorithms CS4231 in NUS which helped me get some basic understanding so you can consider taking those if you are interested. If you want to see how an open source database looks like, I would recommend TiDB because their documentation is quite good.

  • GitHub repo SheetJS js-xlsx

    :green_book: SheetJS Community Edition -- Spreadsheet Data Toolkit

    Project mention: Is there way to create hierarchical CSV file in JavaScript | | 2021-10-13

    That said, if Excel is your goal, you can create Excel files directly from JavaScript using xlsx.js. There's a lot of information there, but I've used this a lot to create and/or read from Excel files in JavaScript.

  • GitHub repo LevelDB

    LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.

    Project mention: How to set up an Electrum Server on Windows machine? | | 2021-09-06

    Here you go: You'll need python 3.7 or later, and LevelDB Both available for Windows so it should work fine :)

  • GitHub repo Metabase

    The simplest, fastest way to get business intelligence and analytics to everyone in your company :yum:

    Project mention: Metabase VS Chartbrew - a user suggested alternative | | 2021-10-26
  • GitHub repo TypeORM

    ORM for TypeScript and JavaScript (ES7, ES6, ES5). Supports MySQL, PostgreSQL, MariaDB, SQLite, MS SQL Server, Oracle, SAP Hana, WebSQL databases. Works in NodeJS, Browser, Ionic, Cordova and Electron platforms.

    Project mention: Why is TypeORM hated so much? | | 2021-10-16

    This bug is a total showstopper for our app, and it was randomly introduced in a minor version update way back in March:

  • Nanos

    Run Linux Software Faster and Safer than Linux with Unikernels.

  • GitHub repo Sequelize

    An easy-to-use multi SQL dialect ORM tool for Node.js

    Project mention: Looking for a mentor who can teach me backend using node js. | | 2021-10-21
  • GitHub repo awesome-cheatsheets

    👩‍💻👨‍💻 Awesome cheatsheets for popular programming languages, frameworks and development tools. They include everything you should know in one single file.

    Project mention: Awesome Cheatsheets | | 2021-10-13
  • GitHub repo Mongoose

    MongoDB object modeling designed to work in an asynchronous environment.

    Project mention: Transitioning from MySQL to MongoDB | | 2021-10-25

    To go through this article, we'll use the Mongoose npm package.

  • GitHub repo dbeaver

    Free universal database tool and SQL client

    Project mention: How to Change Another User's Password? | | 2021-10-06
  • GitHub repo cockroach

    CockroachDB - the open source, cloud-native distributed SQL database.

    Project mention: CockroachDB Grants and Schemas explained | | 2021-08-28

    And here:

  • GitHub repo InfluxDB

    Scalable datastore for metrics, events, and real-time analytics

    Project mention: Honestly, is Go useful for anything but microservices? | | 2021-10-20

    No, not really.

  • GitHub repo SQLMap

    Automatic SQL injection and database takeover tool

    Project mention: How do password hashes reach the public? | | 2021-10-22

    In the real life the syntax may become very cumbersome depending on the application and database specifics, filtering in place, etc. Tools like sqlmap do that automatically, so attackers don't construct the queries themselves.

  • GitHub repo RocksDB

    A library that provides an embeddable, persistent key-value store for fast storage.

    Project mention: Hello guys , needed help for building a key-value data store | | 2021-10-09

    - RocksDB - kv store that uses LSM tree;

  • GitHub repo MongoDB

    The MongoDB Database

    Project mention: Transitioning from MySQL to MongoDB | | 2021-10-25

    The NoSQL database of choice we would be looking at today is MongoDB.

  • GitHub repo ClickHouse

    ClickHouse® is a free analytics DBMS for big data

    Project mention: What is ClickHouse how it compares to PostgreSQL and TimescaleDB for time series | | 2021-10-21

    Hi Ajay! Thanks for the thoughtful response and email. I would love a direct meeting and will contact you shortly.

    I don't mean to gloss over ClickHouse imperfections. There are lots of them. For my money the biggest is that it still takes way too much expertise in ClickHouse for ordinary developers to use it effectively. Part of that is SQL compatibility, part of it is lack of tools of which simple backup is certainly one. To the extent that ClickHouse is risky, the risk is finding (and retaining) staff who can use it properly. Our business at Altinity exists in large part because of this risk, so I know it's real.

    The big aha! experience for me has been that the things like lack of ACID transactions or weak backup mechanisms are not necessarily the biggest issues for most ClickHouse users. I came to ClickHouse from a long background in RDBMS and transactional replication. Things that would be game ending in that environment are not in analytic systems.

    What's more interesting (mind-expanding even) is that techniques like deduplication of inserted blocks and async multi-master replication turn out to be just as important as ACID & backups to achieve reliable systems. Furthermore, services like Kafka that allow you to have DC-level logs are an essential part of building analytic applications that are reliable and performant at scale. We're learning about these mechanisms in the same way that IBM and others developed ACID transaction ideas in the 1970s--by solving problems in real systems. It's really fun to be part of it.

    My comment didn't convey this clearly, for which I heartily apologize. I certainly don't intend to portray ClickHouse as perfect and still less to bash Timescale. I don't know enough about the latter to make any criticism worth reading.

    p.s., Non-transactional insert (specifically non-atomicity across blocks and tables) is an undisputed problem. It's being fixed in Altinity and others are working on backups. Backup comes up in my job just about every day.

  • GitHub repo MeiliSearch

    Powerful, fast, and an easy to use search engine

    Project mention: Scaling Indexing and Search – Algolia New Search Architecture | | 2021-10-15
  • GitHub repo postgrest

    REST API for any Postgres database

    Project mention: Can we trust Microsoft with Open Source? | | 2021-10-23

    That's not true, for example in PostgREST we setup a nix-shell[1] that allows us to run tests in different PostgreSQL versions(from 9.6 to 14).


  • GitHub repo Prisma

    Next-generation ORM for Node.js & TypeScript | PostgreSQL, MySQL, MariaDB, SQL Server, SQLite & MongoDB (Preview)

    Project mention: Contentlayer & Effect — Architectural Patterns And Decisions. | | 2021-10-25

    Johannes Schickling  — Founder of Prisma and creator of Contentlayer.

  • GitHub repo prisma1

    💾 Database Tools incl. ORM, Migrations and Admin UI (Postgres, MySQL & MongoDB)

    Project mention: Preferred SQL ORM | | 2021-10-16

    Mongoose is quite a standard also open-source, but Prisma is an emerging modern solution that seems to take the cake.

  • GitHub repo dgraph

    Native GraphQL Database with graph backend

    Project mention: Uber using External Consistency database Google Cloud Spanner | | 2021-09-30

    Thanks, cool. I will check out

  • GitHub repo MySQL

    A pure node.js JavaScript Client implementing the MySQL protocol.

    Project mention: How does one make a fully functional professional website? | | 2021-08-18
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2021-10-26.


What are some of the best open-source Database projects? This list will help you:

Project Stars
1 prometheus 39,205
2 etcd 37,595
3 tidb 29,311
4 SheetJS js-xlsx 27,581
5 LevelDB 26,715
6 Metabase 26,301
7 TypeORM 25,960
8 Sequelize 25,120
9 awesome-cheatsheets 25,105
10 Mongoose 23,367
11 dbeaver 22,859
12 cockroach 22,278
13 InfluxDB 22,255
14 SQLMap 21,386
15 RocksDB 20,989
16 MongoDB 20,596
17 ClickHouse 19,949
18 MeiliSearch 19,105
19 postgrest 17,765
20 Prisma 17,003
21 prisma1 16,845
22 dgraph 16,804
23 MySQL 16,772
Find remote jobs at our new job board There are 38 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives