Our great sponsors
|6 days ago||7 days ago|
|Apache License 2.0||GNU General Public License v3.0 or later|
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
SQLite-based databases on the Postgres protocol? Yes we can
11 projects | news.ycombinator.com | 25 Jan 2023
- Oh, and if you're wondering about backup to S3, they have that too: https://github.com/libsql/bottomless
- Uh, sqld can integrated with this https://github.com/losfair/mvsqlite, so now your SQLite is backed by FoundationDB!?
- Meanwhile Litestream exists https://github.com/benbjohnson/litestream/
We Built Fly Postgres
4 projects | news.ycombinator.com | 30 Nov 2022
This was on HN a few months back: https://github.com/losfair/mvsqlite
While not Spanner, it is essentially an open source db like AlloyDB or Aurora, pushing replication and scale out to the storage layer (in this case via FoundationDB). The most interesting bit of mvsqlite is it's multi-writer capabilities, using FoundationDB to perform page-level locks.
I'm neither the creator nor using it in production, but I'd love to see more DBs using FoundationDB as storage. It's a pretty cool solution.4 projects | news.ycombinator.com | 30 Nov 2022
Litestream doesn't do SQLite replication anymore (LiteFS does)
9 projects | news.ycombinator.com | 14 Oct 2022
Shameless plug of my [mvSQLite](https://github.com/losfair/mvsqlite) project here! It's basically another distributed SQLite, but with support for everything expected from a proper distributed database: synchronous replication, strictly serializable transactions, + scalable reads and writes w/ multiple concurrent writers.
SQLite: QEMU All over Again?
11 projects | news.ycombinator.com | 4 Oct 2022
The approach to edge-ifying SQLite taken in  looks quite promising - using FoundationDb as the storage handles a lot of hairiness.11 projects | news.ycombinator.com | 4 Oct 2022
This project looks really exciting!
I'm working on mvsqlite , a distributed SQLite based on FoundationDB. When doing the VFS integration I have always wanted to patch SQLite itself, but didn't because of uncertainty around correctness of the patched version...
A few features on my wishlist:
1. Asynchronous I/O. mvsqlite is currently doing its own prefetch prediction that is not very accurate. I assume higher layers in SQLite have more information that can help with better prediction.
2. Custom page allocator. SQLite internally uses a linked list to manage database pages - this causes contention on any two transactions that both allocate or free pages.
3. Random ROWID, without the `max(int64)` row trick. Sequentially increasing ROWIDs is a primary source of contention, and causes significant INSERT slowdown in my benchmark .
Show HN: Query SQLite files stored in S3
10 projects | news.ycombinator.com | 13 Sep 2022
That DynamoDB VFS looks cool! I agree that the VFS api makes one think about plenty of crazy ideas. Someone is working on a VFS based on Foundation DB that looks very promising. It was recently discussed here
Turning SQLite into a Distributed Database
8 projects | news.ycombinator.com | 21 Aug 2022
Litestream/LiteFS are amazing projects. The FUSE-based approach is interesting (I'm implementing something similar in mvSQLite, thanks for the idea!)
> Graceful failure
mvSQLite is designed to continue to operate under degraded network (there is a fault-injection test specifically for checking this property: https://github.com/losfair/mvsqlite/blob/1dd1a80d2ff7263b07a...). Network errors and service unavailability are handled with idempotent retries and not exposed to the application.
> Good for caching
mvSQLite caches pages read and written, and does differential cache invalidation (only remotely modified pages are invalidated in the local page cache). The local cache is just a regular KV store with invalidation strategies, and can be moved onto the disk. So it essentially becomes a consistent local database snapshot.
SQLite is not a toy database
Came over this article as I was looking for interesting resources in the SQLite ecosystem. I'm building mvsqlite (https://github.com/losfair/mvsqlite), as an attempt to turn SQLite into a proper distributed (not just replicated) database. Check it out if you are looking for this kind of stuff!
There's a page in the wiki doing the comparison: https://github.com/losfair/mvsqlite/wiki/Comparison-with-dql...
Strong Consistency with Raft and SQLite
6 projects | news.ycombinator.com | 21 Mar 2023
9 years of open-source database development: reviewing the designs
2 projects | reddit.com/r/programming | 10 Mar 2023
Anyone knows how the DB this is about, https://rqlite.io/, compares with https://dqlite.io/ by Canonical (both seem to be distributed versions of sqlite)?
SQLite the only database you will ever need in most cases
12 projects | news.ycombinator.com | 15 Feb 2023
Transcending Posix: The End of an Era?
8 projects | news.ycombinator.com | 10 Sep 2022
For folks' context, the new tool that's being discussed in the thread mentioned by the parent here is litefs , as well as which you can also look at rqlite  and dqlite , which all provide different trade-offs (e.g. rqlite is 'more strongly consistent' than litefs).
SQLite is not a toy database
I presume you're familiar with https://github.com/canonical/dqlite (made by my employer) and https://github.com/rqlite/rqlite (unrelated)? How will mvsqlite compare to those?
GitDB, a distributed embeddable database on top of Git
4 projects | news.ycombinator.com | 5 Jul 2022
Check out dqlite, it's sqlite but with a raft consensus to distribute changes through a log: https://dqlite.io/ You can link it in as a library too, it sounds like exactly what you want.
Ask HN: Free and open source distributed database written in C++ or C
12 projects | news.ycombinator.com | 16 May 2022
Fly.io Buys Litestream
15 projects | news.ycombinator.com | 9 May 2022
I’m sure there’s more, those are just the ones I remember.15 projects | news.ycombinator.com | 9 May 2022
17 projects | dev.to | 28 Apr 2022
dqlite - Embeddable, replicated and fault tolerant SQL engine
What are some alternatives?
rqlite - The lightweight, distributed relational database built on SQLite
kine - Run Kubernetes on MySQL, Postgres, sqlite, dqlite, not etcd.
litestream - Streaming replication for SQLite.
boringproxy - Simple tunneling reverse proxy with a fast web UI and auto HTTPS. Designed for self-hosters.
Bedrock - Rock solid distributed database specializing in active/active automatic failover and WAN replication
better-sqlite3 - The fastest and simplest library for SQLite3 in Node.js.
SQLite - Official Git mirror of the SQLite source tree
edge-sql - Cloudflare Workers providing a SQL API
litefs - FUSE-based file system for replicating SQLite databases across a cluster of machines
Olric - Distributed in-memory object store. It can be used both as an embedded Go library and as a language-independent service.
ipfs-cluster - Pinset orchestration for IPFS