citus
absurd-sql
citus | absurd-sql | |
---|---|---|
61 | 24 | |
9,860 | 4,063 | |
1.4% | - | |
9.4 | 2.5 | |
12 days ago | 9 months ago | |
C | JavaScript | |
GNU Affero General Public License v3.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
citus
- SPQR 1.3.0: a production-ready system for horizontal scaling of PostgreSQL
- Citus: PostgreSQL extension that transforms Postgres into a distributed database
-
Figma's Databases team lived to tell the scale
I see they don't mention Citus (https://github.com/citusdata/citus), which is already a fairly mature native Postgres extension. From the details given in the article, in sounds like they just reimplemented it.
I wonder if they were unaware of it or disregarded it for a reason —I currently am in a similar situation as the one described in the blog, trying to shard a massive Postgres DB.
-
PostgreSQL Is Enough
It is possible, if you pay for it. You can do Multi-AZ Clustered Instances in RDS, where you get the benefits of Multi-AZ failover with traffic sharing.
If you can run your own infra – at least on an EC2 level – you can do things like Citus [0] for Postgres, which is about as close to "just add database nodes" as you'll get.
[0]: https://www.citusdata.com/
-
Vitess 18
So while searching for something like this for postgres I came across citus. Any one know how that stacks up?
https://github.com/citusdata/citus
- In-Depth Guide: Citus Technical Readme
-
Revolutionizing Database Scaling with CitusDB
References: CitusDB
- Squeeze the hell out of the system you have
- Show HN: Hydra 1.0 – open-source column-oriented Postgres
- Schema-based sharding comes to PostgreSQL with Citus
absurd-sql
- Absurd-SQL: sqlite3 in ur indexeddb (hopefully a better back end soon)
- What If OpenDocument Used SQLite?
-
WASM SQL database recommendations wanted
Not really, but I'm aware of absurd-sql. Note that this requires IndexedDB and thus a browser environment.
-
Best local database that works on all platforms including web?
I don't need SQL capabilities, so I didn't look into those options (there's also absurd-sql, which ports sqlite to the browser on top of IndexedDB).
-
SQLite WASM in the Browser Backed by the Origin Private File System
Ironically I was just about to drop in absurd-sql [1] to a project, which uses indexeddb to back SQLite. This seems better.
[1] https://github.com/jlongster/absurd-sql
-
Irmin in the Browser (OCaml/MirageOS)
There is also absurd-sql that is sqlite3 in wasm using IndexDB as storage and it’s faster than IndexDB itself
[1]: https://github.com/jlongster/absurd-sql
-
Postgres WASM by Snaplet and Supabase
Offline data: running it in the browser for an offline cache, similar to sql.js or absurd-sql.
- WordPress WASM
-
Learn PWA
We are very close to having WASM SQLite with persistence in the web platform. Until now SQLite compiled to WASM was in memory and you had to write the whole database out as a binary array to save changes. There is absurd-sql (https://github.com/jlongster/absurd-sql), which builds a virtual file system on top of IndexedDB for sqlite, its incredible, but a bit of an ugly hack.
However, the new file-access apis (https://developer.mozilla.org/en-US/docs/Web/API/File_System...) that are landing in browsers will fix this. One of the things it does is enable very efficient block level read/write access to a privet sandboxed filesystem for the websites origin, perfect for persistent sqlite. There is more here: https://web.dev/file-system-access/#accessing-files-optimize...
- Learn Postgres at the Playground
What are some alternatives?
Greenplum - Greenplum Database - Massively Parallel PostgreSQL for Analytics. An open-source massively parallel data platform for analytics, machine learning and AI.
lovefield - Lovefield is a relational database for web apps. Written in JavaScript, works cross-browser. Provides SQL-like APIs that are fast, safe, and easy to use.
yugabyte-db - YugabyteDB - the cloud native distributed SQL database for mission-critical applications.
crdt-example-app - A full implementation of CRDTs using hybrid logical clocks and a demo app that uses it
vitess - Vitess is a database clustering system for horizontal scaling of MySQL.
dolt - Dolt – Git for Data
TimescaleDB - An open-source time-series SQL database optimized for fast ingest and complex queries. Packaged as a PostgreSQL extension.
realtime - Broadcast, Presence, and Postgres Changes via WebSockets
dbt-core - dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
donutdb - Store and query a sqlite db directly backed by DynamoDB.
stolon - PostgreSQL cloud native High Availability and more.
localForage - 💾 Offline storage, improved. Wraps IndexedDB, WebSQL, or localStorage using a simple but powerful API.