Database

Open-source projects categorized as Database

Top 23 Database Open-Source Projects

  • prometheus

    The Prometheus monitoring system and time series database.

    Project mention: The Complete Microservices Guide | dev.to | 2023-09-21

    Monitoring and Logging: Middleware often includes monitoring and logging components like ELK Stack, Prometheus, and Grafana to track the health, performance, and behavior of microservices. This aids in troubleshooting and performance optimization.

  • etcd

    Distributed reliable key-value store for the most critical data of a distributed system

    Project mention: The Complete Microservices Guide | dev.to | 2023-09-21

    Service Discovery: Microservices need to discover and communicate with each other dynamically. Service discovery tools like etcd, Consul, or Kubernetes built-in service discovery mechanisms help locate and connect to microservices running on different nodes within the infrastructure.

  • SonarQube

    Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.

  • MeiliSearch

    A lightning-fast search engine that fits effortlessly into your apps, websites, and workflow.

    Project mention: Looking for an easy installable search engine for a shared hosting account? Any ideas? | /r/selfhosted | 2023-09-08
  • tidb

    TiDB is an open-source, cloud-native, distributed, MySQL-Compatible database for elastic scale and real-time analytics. Try AI-powered Chat2Query free at : https://tidbcloud.com/free-trial

    Project mention: TiDB: Open-source, cloud-native, distributed, MySQL compatible database | news.ycombinator.com | 2023-08-30
  • awesome-cheatsheets

    👩‍💻👨‍💻 Awesome cheatsheets for popular programming languages, frameworks and development tools. They include everything you should know in one single file.

    Project mention: Cool Github repositories for Everyone | dev.to | 2022-12-29
  • Metabase

    The simplest, fastest way to get business intelligence and analytics to everyone in your company :yum:

    Project mention: My mental model of Clojure transducers | news.ycombinator.com | 2023-09-10

    It seems folks want a working example. Here's one in prod:

    Metabase is a BI tool, backend written mostly in Clojure. Like basically all BI tools they have this intermediate representation language thing so you write the same thing in "MBQL (metabase query language)" and it theoretically becomes same query in like, Postgres and Mongo and whatever. End user does not usually write MBQL, it's a service for the frontend querybuilding UI thing and lots of other frontend UI stuff mainly in usage.

    Whole processing from MBQL -> your SQL or whatever is done via a buncha big-ass transducers. Metabase is not materially faster than other BI tools (because all the other BI tools do something vaguely similar in their langs) but it's pretty comparable speed and the whole thing was materially written by like 5 peeps

    https://github.com/metabase/metabase/blob/master/src/metabas...

    (nb: I used to work for Metabase but currently do not. but open core is open core)

  • Prisma

    Next-generation ORM for Node.js & TypeScript | PostgreSQL, MySQL, MariaDB, SQL Server, SQLite, MongoDB and CockroachDB

    Project mention: How To Manage Access and Refresh Tokens for an API in Next.js 13 With Supabase and Prisma | dev.to | 2023-09-22

    So, we will use Supabase as a Postgres database to store the tokens and Prisma as our ORM of choice to communicate with our database.

  • Mergify

    Tired of breaking your main and manually rebasing outdated pull requests?. Managing outdated pull requests is time-consuming. Mergify's Merge Queue automates your pull request management & merging. It's fully integrated to GitHub & coordinated with any CI. Start focusing on code. Try Mergify for free.

  • dbeaver

    Free universal database tool and SQL client

    Project mention: 👻Top 8 Free, Open Source SQL Clients🔥 | dev.to | 2023-09-04

    DBeaver is a veteran SQL client. In addition to basic visualization and management capabilities, it has a SQL editor, data and schema migration capabilities, monitor database connections, and more. It supports a full range of databases (both SQL and NoSQL). DBeaver is also hooked up with GPT-3, which converts your natural language to SQL.

  • SheetJS js-xlsx

    📗 SheetJS Spreadsheet Data Toolkit -- New home https://git.sheetjs.com/SheetJS/sheetjs

    Project mention: how to work with .xlsx files? | /r/node | 2023-06-28

    ExcelJS and XLSX (SheetJS) are great libraries to work with XLSX files. The former I've found a bit easier to work with but less efficient in general.

  • LevelDB

    LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.

    Project mention: Bloom filter support to leveldb by Sanjay Ghemawat | news.ycombinator.com | 2023-08-02
  • TypeORM

    ORM for TypeScript and JavaScript. Supports MySQL, PostgreSQL, MariaDB, SQLite, MS SQL Server, Oracle, SAP Hana, WebSQL databases. Works in NodeJS, Browser, Ionic, Cordova and Electron platforms.

    Project mention: TypeOrm transaction doesn't work [Help] | /r/node | 2023-09-18
  • ClickHouse

    ClickHouse® is a free analytics DBMS for big data

    Project mention: Is ClickHouse Moving Away from Open Source? | news.ycombinator.com | 2023-09-22

    What's the "AWS VPC Gateway Endpoint" support you refer to? Do you mean an S3 proxy? If so one of our PRs that just merged may be helpful. [0]

    [0] https://github.com/ClickHouse/ClickHouse/pull/51749

  • Sequelize

    Feature-rich ORM for modern Node.js and TypeScript, it supports PostgreSQL (with JSON and JSONB support), MySQL, MariaDB, SQLite, MS SQL Server, Snowflake, Oracle DB (v6), DB2 and DB2 for IBM i.

    Project mention: ERDIA: TypeORM entity specification documentation tool | dev.to | 2023-08-28

    The image above is a chart comparing three popular ORM tools from the npmtrends.com. ERDIA only supports TypeORM for now, but the roadmap is to support Sequelize and Prisma as well.

  • SQLMap

    Automatic SQL injection and database takeover tool

    Project mention: Enhancing Code Quality and Security: Building a Rock-Solid CI Test Suite for Seamless Development | dev.to | 2023-07-03

    The DAST checks can be automated up to a certain point, where the code should be able to withstand certain scans and attacks. For eg. SQL Injections can be checked with sqlmap which tests with each and every type of sql injection payload and reports it back to the user.

  • cockroach

    CockroachDB - the open source, cloud-native distributed SQL database.

    Project mention: Is it bad to create a publicly accessible RDS database for my serverless web app? | /r/aws | 2023-08-11

    For example, when you create a serverless postgres database with a platform like CockroachDB or Neon, you effectively get a connection string with a strong password. Anyone can connect to your database from anywhere so long as they have the right connection string. There are no security settings in these services to change this behavior.

  • InfluxDB

    Scalable datastore for metrics, events, and real-time analytics

    Project mention: InfluxDB 3 is out, OSS commits have been tried up - is this the end? | /r/influxdb | 2023-05-10
  • RocksDB

    A library that provides an embeddable, persistent key-value store for fast storage.

    Project mention: In-memory vs. disk-based databases: Why do you need a larger than memory architecture? | dev.to | 2023-09-05

    The in-memory version of Memgraph uses Delta storage to support multi-version concurrency control (MVCC). However, for larger-than-memory storage, we decided to use the Optimistic Concurrency Control Protocol (OCC) since we assumed conflicts would rarely happen, and we could make use of RocksDB’s transactions without dealing with the custom layer of complexity like in the case of Delta storage.

  • Mongoose

    MongoDB object modeling designed to work in an asynchronous environment.

    Project mention: Mongoose Handbook | dev.to | 2023-09-08

    Mongoose is a popular JavaScript library used with MongoDB, a NoSQL database. It provides an elegant and user-friendly way to interact with MongoDB from Node.js applications. Mongoose offers several key benefits:

  • MongoDB

    The MongoDB Database

    Project mention: MongoDB’s New Query Engine | news.ycombinator.com | 2023-09-21
  • Directus

    The Modern Data Stack 🐰 — Directus is an instant REST+GraphQL API and intuitive no-code data collaboration app for any SQL database.

    Project mention: Building a User Feedback Widget with Vue.js and Directus | dev.to | 2023-09-21

    One of our DevRel initiatives at Directus is constantly improving our documentation. As a small team with finite time and resources, we rely a lot on user feedback to help guide our writing efforts. But we were missing the most important bit there – your feedback.

  • Milvus

    A cloud-native vector database, storage for next generation AI applications

    Project mention: Code Search with Vector Embeddings: A Transformer's Approach | dev.to | 2023-08-27

    As the size of the codebase grows, storing and searching through embeddings in memory becomes inefficient. This is where vector databases come into play. Tools like Milvus, Faiss, and others are designed to handle large-scale vector data and provide efficient similarity search capabilities. I've wrtten about how to also use sqlite to store vector embeddings. By integrating a vector database, you can scale your code search tool to handle much larger codebases without compromising on search speed.

  • surrealdb

    A scalable, distributed, collaborative, document-graph database, for the realtime web

    Project mention: How to Design a SurrealDB schema and create a basic client for TypeScript | dev.to | 2023-09-17

    In the midst of a dynamic landscape of exciting new projects, one name shines bright — SurrealDB.

  • TDengine

    TDengine is an open source, high-performance, cloud native time-series database optimized for Internet of Things (IoT), Connected Cars, Industrial IoT and DevOps.

    Project mention: TDengine: NEW Data - star count:21596.0 | /r/algoprojects | 2023-08-06
  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-09-22.

Database related posts

Index

What are some of the best open-source Database projects? This list will help you:

Project Stars
1 prometheus 49,935
2 etcd 44,516
3 MeiliSearch 38,807
4 tidb 34,864
5 awesome-cheatsheets 34,612
6 Metabase 34,105
7 Prisma 33,817
8 dbeaver 33,795
9 SheetJS js-xlsx 33,571
10 LevelDB 33,555
11 TypeORM 32,113
12 ClickHouse 30,809
13 Sequelize 28,426
14 SQLMap 28,161
15 cockroach 27,812
16 InfluxDB 26,110
17 RocksDB 26,028
18 Mongoose 26,022
19 MongoDB 24,381
20 Directus 23,153
21 Milvus 22,993
22 surrealdb 22,480
23 TDengine 21,751
Collect and Analyze Billions of Data Points in Real Time
Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
www.influxdata.com