The Notifier Pattern for Applications That Use Postgres

• materialize

  120 5,621 10.0 Rust

  The data warehouse for operational workloads. (by MaterializeInc)

  

Take a look at Materialize, Noria and the family of Differential/Timely Dataflow technologies. It's the same concept on steroids, you can subscribe to arbitrary queries and efficiently receive any changes to that view. You can also efficiently maintain any materialized view for extremely fast reads across all endpoints.

Quite underrated, it has so much promise. The concept is not new but it's still semi-stuck in Rust-land. It's becoming more mainstream with Materialize, which is technically open-source, but they are quite aggressive with pushing their cloud and offuscating on-prem usage.

https://github.com/MaterializeInc/materialize

https://github.com/mit-pdos/noria

https://timelydataflow.github.io/differential-dataflow/

https://timelydataflow.github.io/timely-dataflow/

• postgres

  43 6,863 8.0 JavaScript

  Postgres.js - The Fastest full featured PostgreSQL client for Node.js, Deno, Bun and CloudFlare (by porsager)

Great post!

Postgres.js actually does this implicitly through a simple API[1] mimicking the postgres way, thereby using only a single dedicated connection for listening per process.

Listen/notify is also super useful with triggers.

[1] https://github.com/porsager/postgres

• SurveyJS

  surveyjs.io featured

  Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

  

• pg-promise

  18 3,427 8.2 JavaScript

  PostgreSQL interface for Node.js

• noria

  28 4,925 0.0 Rust

  Fast web applications through dynamic, partially-stateful dataflow

  

Take a look at Materialize, Noria and the family of Differential/Timely Dataflow technologies. It's the same concept on steroids, you can subscribe to arbitrary queries and efficiently receive any changes to that view. You can also efficiently maintain any materialized view for extremely fast reads across all endpoints.

Quite underrated, it has so much promise. The concept is not new but it's still semi-stuck in Rust-land. It's becoming more mainstream with Materialize, which is technically open-source, but they are quite aggressive with pushing their cloud and offuscating on-prem usage.

https://github.com/MaterializeInc/materialize

https://github.com/mit-pdos/noria

https://timelydataflow.github.io/differential-dataflow/

https://timelydataflow.github.io/timely-dataflow/

• pg_ivm

  21 837 6.3 C

  IVM (Incremental View Maintenance) implementation as a PostgreSQL extension

  

Indeed! It would be so much better if this were a Postgres extension instead.

There are some efforts but still quite immature: https://github.com/sraoss/pg_ivm

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project