sqlite-zstd: Transparent dictionary-based row-level compression for SQLite - An SQLite extension written in Rust to reduce the database size without losing functionality

This page summarizes the projects mentioned and recommended in the original post on /r/rust

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • FlatBuffers

    FlatBuffers: Memory Efficient Serialization Library

    Using a schema-based format would help more (such as capnproto, flatbuffers or bincode). The disadvantage here is that these all require you to define a an exact and strict schema of the data. This in most cases leads to code duplication in another schema language (usually a completely new DSL, see the capnproto link). It also doesn't work for arbitrary data that you e.g. receive from external sources.

  • GenomicSQLite

    Genomics Extension for SQLite

    Yes, that is indeed an obviously missing part. I knew about ZIPVFS, but somehow forgot to investigate closer. Probably because I started this project before GenomicsSQLite was a thing (that seems like the best alternative).

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts