Developing in Dagster

• dagster-example-pipeline

  1 64 0.0 Python

  Template Dagster repo using poetry and a single Docker container; works well with CICD

  

The associated code repo can be found here

• dagster

  46 10,215 10.0 Python

  An orchestration platform for the development, production, and observation of data assets.

  

I’ve been exploring dagster for some of Mile Two’s data orchestration needs and have been absolutely loving it. It hits all of the sweet spots for gradually developing data pipelines, but I found myself in a familiar situation: trying to logically structure my code such that it can easily be containerized and thrown into a CI/CD process. To that end, I’ve open-sourced a boilerplate project that enhances the dagster development experience with these valuable features:

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project