#Database

Open-source projects categorized as Database
Related topics: #SQL #Postgresql #MySQL #ORM #Go

Top 23 Database Open-Source Projects

  • GitHub repo prometheus

    The Prometheus monitoring system and time series database.

    Project mention: Fortigate Exporter for Prometheus | reddit.com/r/networking | 2021-03-02

    I am a fan of Fortigate firewalls, I use them myself quite a bit. I am also a long term fan of Prometheus (a commonly used metrics database), and Grafana.

  • GitHub repo etcd

    Distributed reliable key-value store for the most critical data of a distributed system

    Project mention: Protocol Buffers | reddit.com/r/golang | 2021-03-02
  • Scout

    Get performance insights in less than 4 minutes. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.

  • GitHub repo tidb

    TiDB is an open source distributed HTAP database compatible with the MySQL protocol

    Project mention: Gopher Gold #21 - Wed Nov 25 2020 | dev.to | 2020-11-24

    pingcap/tidb (Go): TiDB is an open source distributed HTAP database compatible with the MySQL protocol

  • GitHub repo SheetJS js-xlsx

    :green_book: SheetJS Community Edition -- Spreadsheet Data Toolkit

    Project mention: How can I map data from an excel sheet through react? | reddit.com/r/reactjs | 2021-02-19

    React is a library that only cares about rendering JavaScript data on the DOM and related stuff. If you need to read an Excel file and transform it into a JavaScript object, you need to use the html file picker and, once you load the blob, a library to parse this blob. Last time I used https://github.com/SheetJS/sheetjs

  • GitHub repo Metabase

    The simplest, fastest way to get business intelligence and analytics to everyone in your company :yum:

    Project mention: Ask HN: Who is hiring? (March 2021) | news.ycombinator.com | 2021-03-01

    Metabase | https://metabase.com | REMOTE | Full-time | Backend, Frontend, Full Stack, and DevOps engineers

    We're hiring for multiple positions across the Engineering team (and in many other non-engineering roles).

    Metabase is open source analytics software that makes it easy for anyone in your company to ask questions of your data. It interfaces with a number of databases / data warehouses (BigQuery, Redshift, Snowflake, Postgres, MySQL, etc) and has a simple and powerful UI and UX that sits on top of it.

  • GitHub repo Sequelize

    An easy-to-use multi SQL dialect ORM tool for Node.js

    Project mention: How to improve database performance for insert queries | dev.to | 2021-02-27

    About tech Stack, I was working in Node.js with MariaDB and Fastify framework (performs better than express and other sever frameworks or library). I used Sequelize as ORM library, it is a promise-based Node.js ORM for Postgres, MySQL, MariaDB, SQLite and Microsoft SQL Server. To improve the performance of my operations, I needed to run insert operations in multiple batches and those batches had to run in parallel. Aha! Sound nice, but to how to implement it. After spending ample time of searching I found some solution on how to do it. Thanks to Evan Siroky.

  • GitHub repo TypeORM

    ORM for TypeScript and JavaScript (ES7, ES6, ES5). Supports MySQL, PostgreSQL, MariaDB, SQLite, MS SQL Server, Oracle, SAP Hana, WebSQL databases. Works in NodeJS, Browser, Ionic, Cordova and Electron platforms.

    Project mention: Switched from Django to NodeJS need some help | reddit.com/r/node | 2021-02-26

    TypeORM also has a special Version column ( https://github.com/typeorm/typeorm/blob/master/docs/entities.md ) but not the rich history that this Django plugin provides

  • GitHub repo LevelDB

    LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.

    Project mention: What is a LSM Tree 🪵? | dev.to | 2021-02-05

    Born off of that, came LevelDB (2011) by the same authors which uses LSM Tree as its underlying data structure. This gave rise to pluggable storage engines and embedded databases. Around the same time in 2007, Amazon came up with DynamoDB which uses the same underlying LSM Tree structure along with a masterless distributed database design.

  • GitHub repo Mongoose

    MongoDB object modeling designed to work in an asynchronous environment.

    Project mention: Issue with Mongoose create and possible alternative | dev.to | 2021-02-19

    When it comes to ODM layer for Node.JS with MongoDB, Mongoose is the top pick for most of the people. With its wide usage it is quite stable and have almost all the features you need. During my recent usage of Mongoose I came across a bug which exists for quite a while and by the looks of it might take much longer to get it fixed. So here is my take on it.

  • GitHub repo InfluxDB

    Scalable datastore for metrics, events, and real-time analytics

    Project mention: Cannot set the Window Period when creating a check in the Alerts page. Anybody else having this issue? Just greyed out on the auto setting... Using v2.0.3 docker image | reddit.com/r/influxdb | 2021-01-19

    Can you file an issue on https://github.com/influxdata/influxdb/issues? That way I can have an engineer look into it

  • GitHub repo cockroach

    CockroachDB - the open source, cloud-native distributed SQL database.

    Project mention: My Ruby on Rails stack for side projects in 2021 | dev.to | 2021-03-01

    Use a relational database such as PostgreSQL or MySQL. I do not recommend using document databases such as MongoDB because there is really no reason for it in my opinion. PostgreSQL is plenty fast and you probably won't need things like horizontal scaling for a side project. You can of course try something fancy like FaunaDB, CockroachDB, or any of the many database flavors.

  • GitHub repo SQLMap

    Automatic SQL injection and database takeover tool

    Project mention: Iam building a form with a database and try to validate and make it secure. But how can I test it/hack my own form? | reddit.com/r/PHPhelp | 2021-02-10

    sqlmap can be used to test for SQL injections.

  • GitHub repo MongoDB

    The MongoDB Database

    Project mention: mongo: The MongoDB Database | reddit.com/r/u_TsukiZombina | 2021-02-23
  • GitHub repo RocksDB

    A library that provides an embeddable, persistent key-value store for fast storage.

    Project mention: Nano full node on Mac M1 | reddit.com/r/nanocurrency | 2021-02-26

    There's an issue with RocksDB, and some other irritating Cmake things I forgot in the last week. This needs to get merged, for one: https://github.com/facebook/rocksdb/pull/7714

  • GitHub repo prisma1

    💾 Database Tools incl. ORM, Migrations and Admin UI (Postgres, MySQL & MongoDB)

    Project mention: How to deploy Prisma in AWS Lambda with Serverless | dev.to | 2021-02-24

    Prisma is an ORM where a TypeScript client is generated based on a schema so consuming apps have type-safety when querying databases. It also creates binaries to run in different environments. We will need to generate different binaries to run in the dev environment and in a Lambda.

  • GitHub repo postgrest

    REST API for any Postgres database

    Project mention: RFC6238 TOTP implementation in pure PostgreSQL | news.ycombinator.com | 2021-02-24
  • GitHub repo MySQL

    A pure node.js JavaScript Client implementing the MySQL protocol.

    Project mention: How to connect javascript to mysql? | reddit.com/r/webdev | 2021-01-14

    If you're using javascript on the back end in node you'll probably want a node module like mysql on npm. This will give you an api to connect to the database and execute queries. Their readme is very informative so I suggest starting there: https://www.npmjs.com/package/mysql#install

  • GitHub repo dgraph

    Native GraphQL Database with graph backend

    Project mention: What is the difference between mySQL and PostgreSQL | reddit.com/r/webdev | 2021-02-16

    (DGraph)https://dgraph.io/ recently has pivoted and is now offering some degree of GraphQL natively supported as a query language to their database, but I found their documentation to be incomplete for the time being.

  • GitHub repo awesome-cheatsheets

    👩‍💻👨‍💻 Awesome cheatsheets for popular programming languages, frameworks and development tools. They include everything you should know in one single file.

    Project mention: 🧢 Stefan's Web Weekly #6 | dev.to | 2021-02-14

    LeCoupa/awesome-cheatsheets – Awesome cheatsheets for popular programming languages, frameworks and development tools

  • GitHub repo RxDB

    🔄 A realtime Database for JavaScript Applications

    Project mention: The Web After Tomorrow (2015) | news.ycombinator.com | 2021-02-09

    You can mix this with a client-server replication and voila, you have a website that always shows the correct data at each point in time.

    https://github.com/pubkey/rxdb

  • GitHub repo Lowdb

    ⚡️ lowdb is a small local JSON database powered by Lodash (supports Node, Electron and the browser)

    Project mention: Unconventional Databases | dev.to | 2021-02-12

    Files are the most flexible of all. They can store anything in any format you want, but you have to write the querying logic yourself, so it's best to stick to simple formats and don't use them for data where you need complex queries. I think sticking with simple data that fits in a key=value format or JSON (like lowdb) is best.

  • GitHub repo HikariCP

    光 HikariCP・A solid, high-performance, JDBC connection pool at last.

    Project mention: 25 February 2021- Daily Chat Thread | reddit.com/r/indonesia | 2021-02-25
  • GitHub repo ClickHouse

    ClickHouse® is a free analytics DBMS for big data

    Project mention: ClickHouse as an alternative to Elasticsearch for log storage and analysis | news.ycombinator.com | 2021-03-02

    Could you provide more details about the limited of JOIN capabilities? AFAIK, Clickhouse has multiple join algorithms and supports on-disk joins to avoid out of memory:

    https://github.com/ClickHouse/ClickHouse/issues/10830

    https://github.com/ClickHouse/ClickHouse/issues/9702#issueco...

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2021-03-02.

Index

What are some of the best open-source Database projects? This list will help you:

Project Stars
1 prometheus 35,461
2 etcd 34,943
3 tidb 26,926
4 SheetJS js-xlsx 24,750
5 Metabase 23,964
6 Sequelize 23,765
7 TypeORM 23,223
8 LevelDB 23,118
9 Mongoose 22,262
10 InfluxDB 20,543
11 cockroach 19,961
12 SQLMap 19,427
13 MongoDB 19,359
14 RocksDB 18,854
15 prisma1 16,864
16 postgrest 16,602
17 MySQL 16,204
18 dgraph 15,422
19 awesome-cheatsheets 15,303
20 RxDB 15,251
21 Lowdb 14,890
22 HikariCP 14,659
23 ClickHouse 14,615