-
dbt-core
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
dbt-fal
Discontinued do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning models.
They were looking into it at one point (using Snowflake streams to support incremental) https://github.com/dbt-labs/dbt-core/issues/1598
Great write-up! For your logging integration, you might have a look at fal. There's an example of sending events to Datadog