optimus
dagger
optimus | dagger | |
---|---|---|
5 | 1 | |
737 | 255 | |
0.1% | 0.4% | |
4.4 | 2.7 | |
6 months ago | 9 months ago | |
Go | Java | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
optimus
-
Data Engineering Tools in Go
You can check odpf github, they created some dataops tools using go, one of the example is optimus (https://github.com/odpf/optimus) which is a data pipeline orchestrator
-
Modern open-source data platform that empowers organizations to discover, transform, analyse and secure data faster and efficiently.
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
-
Seeking opinions on workflow/DAG orchestration with Go
this may help: https://github.com/odpf/optimus
- Optimus - An easy-to-use, reliable and performant workflow orchestrator for data transformation, data modeling, pipelines and data quality management
- GitHub - odpf/optimus: Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
dagger
-
Modern open-source data platform that empowers organizations to discover, transform, analyse and secure data faster and efficiently.
Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.
What are some alternatives?
cadence - Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.
meteor - Meteor is an easy-to-use, plugin-driven metadata collection framework to extract data from different sources and sink to any data catalog.
Benthos - Fancy stream processing made operationally mundane
firehose - Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.
goflow - A Golang based high performance, scalable and distributed workflow framework
siren - Siren provides an easy-to-use universal alert, notification, channels management framework for the entire observability infrastructure.
protobuf-bigquery-go - Seamlessly save and load protocol buffers to and from BigQuery using Go.
guardian - Guardian is universal data access management tool with automated access workflows and security controls across data stores, analytical systems, and cloud products.
beneath - Beneath is a serverless real-time data platform ⚡️
dagu - Yet another cron alternative with a Web UI, but with much more capabilities. It aims to solve greater problems.
flyte - Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
dbt-documentor - ✍️ dbt doc generator for advanced data teams