rtdl
Shift
rtdl | Shift | |
---|---|---|
2 | 1 | |
43 | 9 | |
- | - | |
0.0 | 8.1 | |
over 1 year ago | 7 months ago | |
Go | Go | |
MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
rtdl
-
Why this subreddit dislikes the so-called Modern Data Stack?
I think my friend and I are building the solution you’re talking about. A real-time data lake that is easy to setup, uses the newest tech (not Spark and Hive), and has an extensible processing layer. https://github.com/realtimedatalake/rtdl. Fingers-crossed, but it looks like we may be a funded startup soon.
-
What is the easiest way to build a real-time data lake?
For context, I work at Segment (including GTM for Segment Data Lakes) and am the co-creator of rtdl (https://github.com/realtimedatalake/rtdl). This is a problem I’m familiar with and trying to solve. I’m really curious about how others make data lakes easier and what solutions are floating around.
Shift
-
Alternative to Airbyte, Singer and Meltano
As side hobby I started working on this personal project https://github.com/piyushsingariya/Kaku
What are some alternatives?
incubator-devlake - Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
amplify - Bacalhau Amplify: automatic enrichment, enhancement, and explanation of your data
flyte - Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
Dataplane - Dataplane is a data platform that makes it easy to construct a data mesh with automated data pipelines and workflows.
dbt-core - dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
pachyderm - Data-Centric Pipelines and Data Versioning