lzsa
citus
lzsa | citus | |
---|---|---|
2 | 61 | |
229 | 9,881 | |
- | 1.6% | |
2.1 | 9.4 | |
5 months ago | 7 days ago | |
C | C | |
GNU General Public License v3.0 or later | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
lzsa
-
The LZ4 introduced in PostgreSQL 14 provides faster compression
True.
If you're on your way down this rabbit hole, there's a bunch of old-machine-specific compression algorithms, developed by the emulator community, e.g. LZSA: https://github.com/emmanuel-marty/lzsa
-
Modern LZ Compression
There's quite a lot of retro modern LZ activity too! LZ turns out to be amazing on old machines, often only several times slower than a block copy. Optimal compressors and control over the algorithm have led to some very tight demos.
https://www.brutaldeluxe.fr/products/crossdevtools/lz4/index... LZ4 Data Compression - a rather long and in-depth article looking at LZ4 on the 65816 for the Apple IIgs
https://github.com/emmanuel-marty/lzsa - LZSA - a LZ4-like modern LZ that's more efficient both in speed and compression to LZ4 (at least on the 8 bitters it targets).
citus
- SPQR 1.3.0: a production-ready system for horizontal scaling of PostgreSQL
- Citus: PostgreSQL extension that transforms Postgres into a distributed database
-
Figma's Databases team lived to tell the scale
I see they don't mention Citus (https://github.com/citusdata/citus), which is already a fairly mature native Postgres extension. From the details given in the article, in sounds like they just reimplemented it.
I wonder if they were unaware of it or disregarded it for a reason —I currently am in a similar situation as the one described in the blog, trying to shard a massive Postgres DB.
-
PostgreSQL Is Enough
It is possible, if you pay for it. You can do Multi-AZ Clustered Instances in RDS, where you get the benefits of Multi-AZ failover with traffic sharing.
If you can run your own infra – at least on an EC2 level – you can do things like Citus [0] for Postgres, which is about as close to "just add database nodes" as you'll get.
[0]: https://www.citusdata.com/
-
Vitess 18
So while searching for something like this for postgres I came across citus. Any one know how that stacks up?
https://github.com/citusdata/citus
- In-Depth Guide: Citus Technical Readme
-
Revolutionizing Database Scaling with CitusDB
References: CitusDB
- Squeeze the hell out of the system you have
- Show HN: Hydra 1.0 – open-source column-oriented Postgres
- Schema-based sharding comes to PostgreSQL with Citus
What are some alternatives?
salvador - A free, open-source compressor for the ZX0 format
Greenplum - Greenplum Database - Massively Parallel PostgreSQL for Analytics. An open-source massively parallel data platform for analytics, machine learning and AI.
apultra - Free open-source compressor for apLib with 5-7% better ratios
yugabyte-db - YugabyteDB - the cloud native distributed SQL database for mission-critical applications.
libi86 - Attempt to reimplement non-standard C library facilities (e.g. <conio.h>) used in MS-DOS programs, for IA-16 GCC & ACK ― mirror of https://gitlab.com/tkchia/libi86 • Ubuntu packages for cross-compilation at https://launchpad.net/%7Etkchia/+archive/ubuntu/build-ia16/ • DJGPP/MS-DOS binaries at https://github.com/tkchia/libi86/releases
vitess - Vitess is a database clustering system for horizontal scaling of MySQL.
pretty6502 - A pretty printer for 6502, Z80, CP1610, TMS9900, and 8088 assembler code
TimescaleDB - An open-source time-series SQL database optimized for fast ingest and complex queries. Packaged as a PostgreSQL extension.
Mad-Pascal - Mad Pascal Compiler for 6502 (Atari XE/XL, C64, C4Plus, Neo6502)
dbt-core - dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
spectrum-desolate - 🕹️ Ported Desolate game from TI-83 Plus to ZX Spectrum
stolon - PostgreSQL cloud native High Availability and more.