Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free. Learn more →
Top 23 Database Open-Source Projects
-
Monitoring and Logging: Middleware often includes monitoring and logging components like ELK Stack, Prometheus, and Grafana to track the health, performance, and behavior of microservices. This aids in troubleshooting and performance optimization.
-
Service Discovery: Microservices need to discover and communicate with each other dynamically. Service discovery tools like etcd, Consul, or Kubernetes built-in service discovery mechanisms help locate and connect to microservices running on different nodes within the infrastructure.
-
SonarQube
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
-
MeiliSearch
A lightning-fast search engine that fits effortlessly into your apps, websites, and workflow.
Project mention: Looking for an easy installable search engine for a shared hosting account? Any ideas? | /r/selfhosted | 2023-09-08 -
tidb
TiDB is an open-source, cloud-native, distributed, MySQL-Compatible database for elastic scale and real-time analytics. Try AI-powered Chat2Query free at : https://tidbcloud.com/free-trial
Project mention: TiDB: Open-source, cloud-native, distributed, MySQL compatible database | news.ycombinator.com | 2023-08-30 -
awesome-cheatsheets
👩💻👨💻 Awesome cheatsheets for popular programming languages, frameworks and development tools. They include everything you should know in one single file.
-
Metabase
The simplest, fastest way to get business intelligence and analytics to everyone in your company :yum:
It seems folks want a working example. Here's one in prod:
Metabase is a BI tool, backend written mostly in Clojure. Like basically all BI tools they have this intermediate representation language thing so you write the same thing in "MBQL (metabase query language)" and it theoretically becomes same query in like, Postgres and Mongo and whatever. End user does not usually write MBQL, it's a service for the frontend querybuilding UI thing and lots of other frontend UI stuff mainly in usage.
Whole processing from MBQL -> your SQL or whatever is done via a buncha big-ass transducers. Metabase is not materially faster than other BI tools (because all the other BI tools do something vaguely similar in their langs) but it's pretty comparable speed and the whole thing was materially written by like 5 peeps
https://github.com/metabase/metabase/blob/master/src/metabas...
(nb: I used to work for Metabase but currently do not. but open core is open core)
-
Prisma
Next-generation ORM for Node.js & TypeScript | PostgreSQL, MySQL, MariaDB, SQL Server, SQLite, MongoDB and CockroachDB
Project mention: How To Manage Access and Refresh Tokens for an API in Next.js 13 With Supabase and Prisma | dev.to | 2023-09-22So, we will use Supabase as a Postgres database to store the tokens and Prisma as our ORM of choice to communicate with our database.
-
Mergify
Tired of breaking your main and manually rebasing outdated pull requests?. Managing outdated pull requests is time-consuming. Mergify's Merge Queue automates your pull request management & merging. It's fully integrated to GitHub & coordinated with any CI. Start focusing on code. Try Mergify for free.
-
DBeaver is a veteran SQL client. In addition to basic visualization and management capabilities, it has a SQL editor, data and schema migration capabilities, monitor database connections, and more. It supports a full range of databases (both SQL and NoSQL). DBeaver is also hooked up with GPT-3, which converts your natural language to SQL.
-
SheetJS js-xlsx
📗 SheetJS Spreadsheet Data Toolkit -- New home https://git.sheetjs.com/SheetJS/sheetjs
ExcelJS and XLSX (SheetJS) are great libraries to work with XLSX files. The former I've found a bit easier to work with but less efficient in general.
-
LevelDB
LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.
Project mention: Bloom filter support to leveldb by Sanjay Ghemawat | news.ycombinator.com | 2023-08-02 -
TypeORM
ORM for TypeScript and JavaScript. Supports MySQL, PostgreSQL, MariaDB, SQLite, MS SQL Server, Oracle, SAP Hana, WebSQL databases. Works in NodeJS, Browser, Ionic, Cordova and Electron platforms.
-
What's the "AWS VPC Gateway Endpoint" support you refer to? Do you mean an S3 proxy? If so one of our PRs that just merged may be helpful. [0]
-
Sequelize
Feature-rich ORM for modern Node.js and TypeScript, it supports PostgreSQL (with JSON and JSONB support), MySQL, MariaDB, SQLite, MS SQL Server, Snowflake, Oracle DB (v6), DB2 and DB2 for IBM i.
The image above is a chart comparing three popular ORM tools from the npmtrends.com. ERDIA only supports TypeORM for now, but the roadmap is to support Sequelize and Prisma as well.
-
Project mention: Enhancing Code Quality and Security: Building a Rock-Solid CI Test Suite for Seamless Development | dev.to | 2023-07-03
The DAST checks can be automated up to a certain point, where the code should be able to withstand certain scans and attacks. For eg. SQL Injections can be checked with sqlmap which tests with each and every type of sql injection payload and reports it back to the user.
-
Project mention: Is it bad to create a publicly accessible RDS database for my serverless web app? | /r/aws | 2023-08-11
For example, when you create a serverless postgres database with a platform like CockroachDB or Neon, you effectively get a connection string with a strong password. Anyone can connect to your database from anywhere so long as they have the right connection string. There are no security settings in these services to change this behavior.
-
Project mention: InfluxDB 3 is out, OSS commits have been tried up - is this the end? | /r/influxdb | 2023-05-10
-
Project mention: In-memory vs. disk-based databases: Why do you need a larger than memory architecture? | dev.to | 2023-09-05
The in-memory version of Memgraph uses Delta storage to support multi-version concurrency control (MVCC). However, for larger-than-memory storage, we decided to use the Optimistic Concurrency Control Protocol (OCC) since we assumed conflicts would rarely happen, and we could make use of RocksDB’s transactions without dealing with the custom layer of complexity like in the case of Delta storage.
-
Mongoose is a popular JavaScript library used with MongoDB, a NoSQL database. It provides an elegant and user-friendly way to interact with MongoDB from Node.js applications. Mongoose offers several key benefits:
-
-
Directus
The Modern Data Stack 🐰 — Directus is an instant REST+GraphQL API and intuitive no-code data collaboration app for any SQL database.
One of our DevRel initiatives at Directus is constantly improving our documentation. As a small team with finite time and resources, we rely a lot on user feedback to help guide our writing efforts. But we were missing the most important bit there – your feedback.
-
As the size of the codebase grows, storing and searching through embeddings in memory becomes inefficient. This is where vector databases come into play. Tools like Milvus, Faiss, and others are designed to handle large-scale vector data and provide efficient similarity search capabilities. I've wrtten about how to also use sqlite to store vector embeddings. By integrating a vector database, you can scale your code search tool to handle much larger codebases without compromising on search speed.
-
Project mention: How to Design a SurrealDB schema and create a basic client for TypeScript | dev.to | 2023-09-17
In the midst of a dynamic landscape of exciting new projects, one name shines bright — SurrealDB.
-
TDengine
TDengine is an open source, high-performance, cloud native time-series database optimized for Internet of Things (IoT), Connected Cars, Industrial IoT and DevOps.
-
InfluxDB
Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
The latest post mention was on 2023-09-22.
Database related posts
- Show HN: TG – Fast geometry library in C
- How To Manage Access and Refresh Tokens for an API in Next.js 13 With Supabase and Prisma
- I'm All-In on Server-Side SQLite
- Is ClickHouse Moving Away from Open Source?
- Corrosion: Gossip-based service discovery for large distributed systems
- Bitmap Scan in YugabyteDB
- MongoDB’s New Query Engine
-
A note from our sponsor - SonarQube
www.sonarqube.org | 23 Sep 2023
Index
What are some of the best open-source Database projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | prometheus | 49,935 |
| 2 | etcd | 44,516 |
| 3 | MeiliSearch | 38,807 |
| 4 | tidb | 34,864 |
| 5 | awesome-cheatsheets | 34,612 |
| 6 | Metabase | 34,105 |
| 7 | Prisma | 33,817 |
| 8 | dbeaver | 33,795 |
| 9 | SheetJS js-xlsx | 33,571 |
| 10 | LevelDB | 33,555 |
| 11 | TypeORM | 32,113 |
| 12 | ClickHouse | 30,809 |
| 13 | Sequelize | 28,426 |
| 14 | SQLMap | 28,161 |
| 15 | cockroach | 27,812 |
| 16 | InfluxDB | 26,110 |
| 17 | RocksDB | 26,028 |
| 18 | Mongoose | 26,022 |
| 19 | MongoDB | 24,381 |
| 20 | Directus | 23,153 |
| 21 | Milvus | 22,993 |
| 22 | surrealdb | 22,480 |
| 23 | TDengine | 21,751 |
Collect and Analyze Billions of Data Points in Real Time
Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
www.influxdata.com