Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 9 dagster Open-Source Projects
-
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
valmi-activation
⚡ valmi.io reverse ETL (data activation) is the open source ( OSS ) data activation platform to load data from warehouses into Webhooks and SaaS tools like Klaviyo, Facebook Ads, Salesforce, Braze etc. Valmi.io Customer Data Platform (CDP) helps track and ingest user activity events from websites, shopify, serverside events. https://cloud.valmi.io
-
portable-data-stack-dagster
A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB, PostgreSQL and Superset
-
-
dagster-example-pipeline
Template Dagster repo using poetry and a single Docker container; works well with CICD
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Level 1 of MLOps is when you've put each lifecycle stage and their intefaces in an automated pipeline. The pipeline could be a python or bash script, or it could be a directed acyclic graph run by some orchestration framework like Airflow, dagster or one of the cloud-provider offerings. AI- or data-specific platforms like MLflow, ClearML and dvc also feature pipeline capabilities.
Project mention: Show HN: Hands-On Data Engineering with a Real-Estate Project Guide | news.ycombinator.com | 2024-03-20
Project mention: Show HN: Valmi.io Open Source Reverse-ETL Engine | news.ycombinator.com | 2023-06-21
Their repo is here: https://github.com/elmpystudio/pyStudio
Project mention: Ask HN: Open-Source Canary Release Tool – Seeking Your Feedback | news.ycombinator.com | 2023-07-14I'm excited to introduce CanaryPy, a new open-source tool to make your data pipelines more robust by introducing new releases of your data pipelines minimising the impact of unanticipated issues. It has a plugin for Apache Airflow for now but more to come.
We'd love for you to check it out on GitHub: https://github.com/thcidale0808/canarypy
Your feedback and suggestions for improvement are precious to us. What features would you like to see? How's the usability? Would you have any thoughts on integration with your current tools?
Thank you in advance for your insights!
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
dagster related posts
-
Show HN: Hands-On Data Engineering with a Real-Estate Project Guide
-
Experience with Dagster.io?
-
Ask HN: Open-Source Canary Release Tool – Seeking Your Feedback
-
Dagster tutorials
-
The Dagster Master Plan
-
An easy way to test before running into code
-
The Why and How of Dagster User Code Deployment Automation
-
A note from our sponsor - InfluxDB
www.influxdata.com | 12 May 2024
Index
What are some of the best open-source dagster projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | dagster | 10,326 |
| 2 | practical-data-engineering | 455 |
| 3 | ngods-stocks | 373 |
| 4 | valmi-activation | 130 |
| 5 | portable-data-stack-dagster | 117 |
| 6 | pyStudio | 115 |
| 7 | dagster-example-pipeline | 64 |
| 8 | dagster-sklearn | 40 |
| 9 | canarypy | 3 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com