Top 23 Database Open-Source Projects
The Prometheus monitoring system and time series database.Latest mention: Troubleshooting the right way | dev.to | 2021-01-25
It worked! Stopping Prometheus broke the active connection that Prometheus previously had with NewRelic. I wasn't aware that remote_write keeps an active connection; I was sure it just sends the data and closes the connection. Apparently, it is documented in the official changelog of Prometheus - 1.8.0 / 2017-10-06 - "..Remote storage connections use HTTP keep-alive..
Distributed reliable key-value store for the most critical data of a distributed systemLatest mention: Gopher Gold #16 - Wed Oct 21 2020 | dev.to | 2020-10-21
etcd-io/etcd (Go): Distributed reliable key-value store for the most critical data of a distributed system
TiDB is an open source distributed HTAP database compatible with the MySQL protocolLatest mention: Gopher Gold #21 - Wed Nov 25 2020 | dev.to | 2020-11-24
pingcap/tidb (Go): TiDB is an open source distributed HTAP database compatible with the MySQL protocol
:green_book: SheetJS Community Edition -- Spreadsheet Data Toolkit
The simplest, fastest way to get business intelligence and analytics to everyone in your company :yum:
You can write these yourself, or just use one that already exists - a popular option for Node is Sequelize: https://github.com/sequelize/sequelize/
LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.Latest mention: But how, exactly, databases use mmap? | dev.to | 2021-01-20
I decided to dig through a database source code to answer that question. There are plenty of databases that use mmap. Some of them decided to not use anymore. Some examples: SQLite has an option of accessing disk content directly using memory-mapped I/O, it seems LevelDB used to use but it changed it, Lucene has an option with MMapDirectory, LMDB uses mmap, a simple key/value in-memory database from Counchbase called moss uses mmap for durability of in-memory data and MongoDB removed mmap storage engine for WiredTiger.
That's fair! FWIW, I don't think you get that kind of certainty with any open source tools? TypeORM had a crazy boost in popularity when it was released and after ~2 years of intense development it was basically dropped and now has a very unclear future. And I don't have a crystal ball to see what's going to happen to Prisma, I just know that we have an amazing team and things are looking incredibly good at the moment. But can I guarantee you that the Prisma open source tools with be around in their current form in 10 years? Nope, in the same way that I can't make these guarantees about any other OSS tools.
MongoDB object modeling designed to work in an asynchronous environment.Latest mention: The right way to make advanced and efficient MongoDB pagination | dev.to | 2021-01-25
Because we use mongoose, as ODM, first of all, we take a look at its plugins. The most popular of them, that related to pagination are mongoose-paginate *Pagination plugin for Mongoose Note: This plugin will only work with Node.js >= 4.0 and Mongoose >= 4.0. Add plugin to…*www.npmjs.com mongoose-paginate-v2 *A cursor based custom pagination library for Mongoose with customizable labels.*www.npmjs.com mongoose-aggregate-paginate *mongoose-aggregate-paginate is a Mongoose plugin easy to add pagination for aggregates. This plugin can be used in…*www.npmjs.com mongoose-aggregate-paginate-v2 *A cursor based custom aggregate pagination library for Mongoose with customizable labels. If you are looking for basic…*www.npmjs.com
Scalable datastore for metrics, events, and real-time analyticsLatest mention: Cannot set the Window Period when creating a check in the Alerts page. Anybody else having this issue? Just greyed out on the auto setting... Using v2.0.3 docker image | reddit.com/r/influxdb | 2021-01-19
Can you file an issue on https://github.com/influxdata/influxdb/issues? That way I can have an engineer look into it
CockroachDB - the open source, cloud-native distributed SQL database.Latest mention: [SL] MangaDex Third Anniversary - Staff AMA | reddit.com/r/manga | 2021-01-24
However if you ever fancy going for a newer tech, CockroachDB is a recent take on distributed SQL databases that's built with scalability in mind. Though from i gathered, deploying it is kind of an experiment in itself.
Automatic SQL injection and database takeover toolLatest mention: (ISC)² Official CISSP Tests mobile app | reddit.com/r/cissp | 2020-12-31
sqlmap does have OS detection capabilities. Official documentation:
The MongoDB DatabaseLatest mention: Official packages for MongoDB and its MongoDB Compass | reddit.com/r/ManjaroLinux | 2020-12-29
A library that provides an embeddable, persistent key-value store for fast storage.Latest mention: LZ4, an Extremely Fast Compression Algorithm | news.ycombinator.com | 2021-01-27
W.r.t. standard dictionaries, it's something we're interested in, but the fundamental reality of dictionaries is that their effectiveness is strongly tied to their specificity. Put another way, a universal dictionary is a self-contradiction.
And yes, totally, I know at least RocksDB supports exactly that behavior .
💾 Database Tools incl. ORM, Migrations and Admin UI (Postgres, MySQL & MongoDB)Latest mention: Is Prisma a viable alternative for TypeORM? | reddit.com/r/node | 2021-01-24
Going with a full rewrite was a painful decision in various ways, but I still think it was necessary (and the steam that Prisma 2 is currently picking up seems to prove it right as well). This rewrite of course had cost a lot of resources and we did our best to provide support and maintenance for Prisma 1 while building out Prisma 2. Once the initial release of Prisma 2 was out, we officially put Prisma 1 in maintenance mode which means that we're still looking into critical and security-related issues with Prisma 1 when they're brought to our attention.
REST API for any Postgres databaseLatest mention: PostgREST: REST API for any Postgres database | reddit.com/r/coolgithubprojects | 2021-01-15
Native GraphQL Database with graph backendLatest mention: Ask HN: Which are the best go repositories to read to learn the language? | news.ycombinator.com | 2021-01-17
I believe the best of the best use of Golang is being done by Dgraph.
They are the The world’s most advanced native GraphQL database with a graph backend.
Checkout their GitHub repo.
👩💻👨💻 Awesome cheatsheets for popular programming languages, frameworks and development tools. They include everything you should know in one single file.Latest mention: Resources | reddit.com/r/developersIndia | 2021-01-21
Awesome cheat sheets
⚡️ lowdb is a small local JSON database powered by Lodash (supports Node, Electron and the browser)Latest mention: NPM package to create a super simple database? | reddit.com/r/node | 2021-01-12
lowdb MIGHT be a good choice. It stores everything in a JSON file and uses Lodash for querying. I have used on a couple of personal projects but it isn't very well maintained (over 100 issues). Personally I really like it! I would never use it in anything serious though lol
光 HikariCP・A solid, high-performance, JDBC connection pool at last.Latest mention: Understanding Connections and Pools | news.ycombinator.com | 2021-01-05
Related, about sizing DB connection (counterintuitively): https://github.com/brettwooldridge/HikariCP/wiki/About-Pool-...
ClickHouse® is a free analytics DBMS for big dataLatest mention: Technology for storing/querying very large time series data (~1billion points per day) with ~80 columns | reddit.com/r/Database | 2021-01-14
Another solution could be to use a columnar analytical database like ClickHouse. But i dont have any experience with it.
What are some of the best open-source Database projects? This list will help you: