optimus
firehose
| optimus | firehose | |
|---|---|---|
| 5 | 3 | |
| 737 | 312 | |
| 0.1% | 0.0% | |
| 4.4 | 2.5 | |
| 6 months ago | 10 months ago | |
| Go | Java | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
optimus
-
Data Engineering Tools in Go
You can check odpf github, they created some dataops tools using go, one of the example is optimus (https://github.com/odpf/optimus) which is a data pipeline orchestrator
-
Modern open-source data platform that empowers organizations to discover, transform, analyse and secure data faster and efficiently.
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
-
Seeking opinions on workflow/DAG orchestration with Go
this may help: https://github.com/odpf/optimus
- Optimus - An easy-to-use, reliable and performant workflow orchestrator for data transformation, data modeling, pipelines and data quality management
- GitHub - odpf/optimus: Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
firehose
-
Modern open-source data platform that empowers organizations to discover, transform, analyse and secure data faster and efficiently.
Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.
- Firehose: Ingest streaming data to various sinks like HTTP REST, GRPC, and various databases. Firehose on daily basis ingest billions of events to our data warehouses and other storage systems. It is Open Source. Check it out and shoot us a star.
- No-Code Kafka sink to stream Protobuf/JSON data
What are some alternatives?
cadence - Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.
kafka-connect-cosmosdb - Kafka Connect connectors for Azure Cosmos DB
Benthos - Fancy stream processing made operationally mundane
kafka-connect-jdbc - Kafka Connect connector for JDBC-compatible databases
goflow - A Golang based high performance, scalable and distributed workflow framework
mongo-kafka - MongoDB Kafka Connector
protobuf-bigquery-go - Seamlessly save and load protocol buffers to and from BigQuery using Go.
kafka-streams-in-action - Source code for the Kafka Streams in Action Book
beneath - Beneath is a serverless real-time data platform ⚡️
transit - A bytes first implementation of the Kafka API within an S3 keyspace
dagu - Yet another cron alternative with a Web UI, but with much more capabilities. It aims to solve greater problems.
Apache Kafka - Mirror of Apache Kafka