s3sqlite
verneuil
s3sqlite | verneuil | |
---|---|---|
5 | 5 | |
457 | 394 | |
0.0% | 1.5% | |
0.0 | 6.7 | |
over 1 year ago | 3 months ago | |
Python | C | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
s3sqlite
verneuil
- Show HN: Query SQLite files stored in S3
-
Embedded database with VFS support?
It'd be process wide. If you want an example can check out the example using a vfs here. There's an explicit passing of vfs there and an implicit usage of it. https://github.com/backtrace-labs/verneuil/blob/main/examples/rusqlite_integration.rs
- LiteFS a FUSE-based file system for replicating SQLite
-
A database for 2022 ยท Tailscale
It doesn't even have to be WAL-based system. Backtrace Labs has a SQLite virtual file system (VFS) called Verneuil that works similarly but works with the rollback journal instead of the WAL.
-
Ask HN: P2P Databases?
https://github.com/backtrace-labs/verneuil/ is one way to address the diffing / read replica part of the problem. I believe it's compatible with gossipping: most of the data is in small content-addressed chunks, with small manifests that tell clients what chunks to fetch and how to reassemble them to recreate a sqlite database. There's already client-side caching to persistent storage, and chunks can be fetched on demand.
Sharing replication data P2P, while retaining the simplicity of a single authoritative writer per database, is explicitly part of the project's long-term goals!
What are some alternatives?
mbtiles-s3-server - Python server to on-the-fly extract and serve vector tiles from an mbtiles file on S3
litefs - FUSE-based file system for replicating SQLite databases across a cluster of machines
s3fs - S3 Filesystem
go-ds-crdt - A distributed go-datastore implementation using Merkle-CRDTs.
filesystem_spec - A specification that python filesystems should adhere to.
dqlite - Embeddable, replicated and fault-tolerant SQL engine.
operations - OSMF Operations Working Group issue tracking
WCDB - WCDB is a cross-platform database framework developed by WeChat.
mvsqlite - Distributed, MVCC SQLite that runs on FoundationDB.
bb-remote-execution - Tools for Buildbarn to allow remote execution of build actions
litestream - Streaming replication for SQLite.