SQLite-based databases on the Postgres protocol? Yes we can

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • postlite

    Discontinued Postgres wire compatible SQLite proxy.

  • Note that this already exists on top of SQLite proper - authored by Ben Johnson (Litestream, Fly.io etc.) - https://github.com/benbjohnson/postlite

  • libsql

    libSQL is a fork of SQLite that is both Open Source, and Open Contributions.

  • Wild stuff

    - Fork of SQLite with new features https://github.com/libsql/libsql

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • sqld

    Discontinued LibSQL with extended capabilities like HTTP protocol, replication, and more.

  • - And you can embed it in your application and it will really talk to a "SQLite" database over the network: https://github.com/libsql/sqld (not a lot on consistency, I wonder how multiple writers are handled?)

  • bottomless

  • - Oh, and if you're wondering about backup to S3, they have that too: https://github.com/libsql/bottomless

    - Uh, sqld can integrated with this https://github.com/losfair/mvsqlite, so now your SQLite is backed by FoundationDB!?

    - Meanwhile Litestream exists https://github.com/benbjohnson/litestream/

  • mvsqlite

    Distributed, MVCC SQLite that runs on FoundationDB.

  • - Oh, and if you're wondering about backup to S3, they have that too: https://github.com/libsql/bottomless

    - Uh, sqld can integrated with this https://github.com/losfair/mvsqlite, so now your SQLite is backed by FoundationDB!?

    - Meanwhile Litestream exists https://github.com/benbjohnson/litestream/

  • litestream

    Streaming replication for SQLite.

  • - Ben is developing https://github.com/superfly/litefs at Fly after stopping the streaming replication effort https://github.com/benbjohnson/litestream/issues/8

    - And, of course, SQLite has announced a new backend that hopes to support concurrent writes and streaming replication: https://sqlite.org/hctree/doc/hctree/doc/hctree/index.html

    What a time for SQLite

  • litefs

    FUSE-based file system for replicating SQLite databases across a cluster of machines

  • - Ben is developing https://github.com/superfly/litefs at Fly after stopping the streaming replication effort https://github.com/benbjohnson/litestream/issues/8

    - And, of course, SQLite has announced a new backend that hopes to support concurrent writes and streaming replication: https://sqlite.org/hctree/doc/hctree/doc/hctree/index.html

    What a time for SQLite

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • StorX

    PHP library for flat-file data storage

  • I wrote a small PHP library that gives you a key-value storage interface to SQlite files: https://github.com/aaviator42/StorX

    I've been dogfooding for a while by using it in my side projects.

    And there's a basic API too, to use it over a network: https://github.com/aaviator42/StorX-API

  • StorX-API

    A REST API for StorX

  • I wrote a small PHP library that gives you a key-value storage interface to SQlite files: https://github.com/aaviator42/StorX

    I've been dogfooding for a while by using it in my side projects.

    And there's a basic API too, to use it over a network: https://github.com/aaviator42/StorX-API

  • roapi

    Create full-fledged APIs for slowly moving datasets without writing a single line of code.

  • Very cool and well executed project. Love the sprinkle of Rust in all the other companion projects as well :)

    The ROAPI(https://github.com/roapi/roapi) project I built also happened to support a similar feature set, i.e. to expose sqlite through a variety of remote query interfaces including pg wire protocols, rest apis and graphqls.

  • stream-sqlite

    Python function to extract rows from a SQLite file while iterating over its bytes

  • Related: michaelc @ uktrade did some intresting work streaming sqlite with python in this repo - https://github.com/uktrade/stream-sqlite

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts