dqlite
ipfs-cluster
Our great sponsors
dqlite | ipfs-cluster | |
---|---|---|
33 | 14 | |
3,713 | 1,452 | |
1.4% | 1.0% | |
8.7 | 7.5 | |
6 days ago | 1 day ago | |
C | Go | |
GNU General Public License v3.0 or later | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
dqlite
-
Marmot: Multi-writer distributed SQLite based on NATS
If you're interested in this, here are some related projects that all take slightly different approaches:
- LiteSync directly competes with Marmot and supports DDL sync, but is closed source commercial (similar to SQLite EE): https://litesync.io
- dqlite is Canonical's distributed SQLite that depends on c-raft and kernel-level async I/O: https://dqlite.io
- cr-sqlite is a Rust-based loadable extension that adds CRDT changeset generation and reconciliation to SQLite: https://github.com/vlcn-io/cr-sqlite
Slightly related but not really (no multi writer, no C-level SQLite API or other restrictions):
- comdb2 (Bloombergs multi-homed RDMS using SQLite as the frontend)
- rqlite: RDMS with HTTP API and SQLite as the storage engine, used for replication and strong consistency (does not scale writes)
- litestream/LiteFS: disaster recovery replication
- liteserver: active read-only replication (predecessor of LiteSync)
- I'm All-In on Server-Side SQLite
-
SQLite performance tuning: concurrent reads, multiple GBs and 100k SELECTs/s
I'd be curious for a similar tuning with Dqlite: https://github.com/canonical/dqlite
- Strong Consistency with Raft and SQLite
-
9 years of open-source database development: reviewing the designs
Anyone knows how the DB this is about, https://rqlite.io/, compares with https://dqlite.io/ by Canonical (both seem to be distributed versions of sqlite)?
- SQLite the only database you will ever need in most cases
-
Transcending Posix: The End of an Era?
For folks' context, the new tool that's being discussed in the thread mentioned by the parent here is litefs [0], as well as which you can also look at rqlite [1] and dqlite [2], which all provide different trade-offs (e.g. rqlite is 'more strongly consistent' than litefs).
[0]: https://github.com/superfly/litefs
[1]: https://github.com/rqlite/rqlite
[2]: https://github.com/canonical/dqlite
-
SQLite is not a toy database
I presume you're familiar with https://github.com/canonical/dqlite (made by my employer) and https://github.com/rqlite/rqlite (unrelated)? How will mvsqlite compare to those?
-
GitDB, a distributed embeddable database on top of Git
Check out dqlite, it's sqlite but with a raft consensus to distribute changes through a log: https://dqlite.io/ You can link it in as a library too, it sounds like exactly what you want.
- Ask HN: Free and open source distributed database written in C++ or C
ipfs-cluster
- BTFS (BitTorrent Filesystem)
-
Blockchain : Création de réseaux privés décentralisés avec EdgeVPN et application à l’opérateur…
IPFS Cluster
-
Reminder: Libgen is also hosted on the IPFS network here, which is decentralized and therefore much harder to take down
As Libgen is an ever-expanding collection wouldn't something like IPFS Cluster fit this a lot better?
- Why the Internet Needs the InterPlanetary File System
-
Fast way to sync ipfs datastores across computers?
There's also IPFS-cluster if you're into those features.
-
Has anyone successfully migrated their content off pinata and onto a self hosted ipfs server?
Then from there, it should be however connectable your server is. If you run multiple, there's ipfs-cluster as an option to sync them. Most of the time I simply send a CID list over ssh.
-
How do I "USE" IPFS Cluster?
The cluster as in https://cluster.ipfs.io/ would control the pinning of data. afaik the control would be private, like what it pins. The docs have a space for a key which I assume controls it.
-
Help Preserve the Internet with Archiveteam's Warrior
AFAIK you can use IPFS (& clusters[0]) without relying on the crypto parts of that ecosystem. That ought to fit rather well with the use case.
[0] https://cluster.ipfs.io/
-
Private Pining Service for Public use
Sounds like a job for IPFS Cluster.
-
Storing Off-Chain data using NFT.Storage
Notably, NFT.Storage includes both long-term "cold storage" in the decentralized Filecoin network, as well as "hot storage" using IPFS Cluster.
What are some alternatives?
rqlite - The lightweight, distributed relational database built on SQLite.
gun - An open source cybersecurity protocol for syncing decentralized graph data.
kine - Run Kubernetes on MySQL, Postgres, sqlite, dqlite, not etcd.
ipfs - Peer-to-peer hypermedia protocol
better-sqlite3 - The fastest and simplest library for SQLite3 in Node.js.
ipfs-cluster-webui - A webui for ipfs-cluster-service
litestream - Streaming replication for SQLite.
Sandstorm - Sandstorm is a self-hostable web productivity suite. It's implemented as a security-hardened web app package manager.
boringproxy - Simple tunneling reverse proxy with a fast web UI and auto HTTPS. Designed for self-hosters.
public-gateway-checker - Checks which public gateways are online or not
Bedrock - Rock solid distributed database specializing in active/active automatic failover and WAN replication
ArchiveBox - 🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...