Moving a Billion Postgres Rows on a $100 Budget

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • cstore_fdw

    Columnar storage extension for Postgres built as a foreign data wrapper. Check out https://github.com/citusdata/citus for a modernized columnar storage implementation built as a table access method.

  • Columnar store PostgreSQL extension exists, here are two but I think I’m missing at least another one:

    https://github.com/citusdata/cstore_fdw

    https://github.com/hydradatabase/hydra

    You can also connect other stores using the foreign data wrappers, like parquet files stored on an object store, duckdb, clickhouse… though the joins aren’t optimised as PostgreSQL would do full scan on the external table when joining.

  • hydra

    Hydra: Column-oriented Postgres. Add scalable analytics to your project in minutes. (by hydradatabase)

  • Columnar store PostgreSQL extension exists, here are two but I think I’m missing at least another one:

    https://github.com/citusdata/cstore_fdw

    https://github.com/hydradatabase/hydra

    You can also connect other stores using the foreign data wrappers, like parquet files stored on an object store, duckdb, clickhouse… though the joins aren’t optimised as PostgreSQL would do full scan on the external table when joining.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts