sqrl
incubator-seatunnel
| sqrl | incubator-seatunnel | |
|---|---|---|
| 2 | 1 | |
| 59 | 5,416 | |
| - | - | |
| 9.3 | 10.0 | |
| 1 day ago | 11 months ago | |
| Java | Java | |
| - | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sqrl
- How do you solve data plumbing? Can we compile it away?
-
Transitioning from user-defined, dynamic schemas in document DB to a relational DB
I think you're looking for document shredding. There are a few different strategies, depending on the query patterns. What you describe is one way, just flatten all the paths (e.g. JSONPath) and have a single table w/ key/value. Another way would be to create tables for each level in the hierarchy, but this way can get complex very quickly. You may want to use a different tool for it, such as https://github.com/DataSQRL/sqrl
incubator-seatunnel
-
Meet Apache SeaTunnel, a new Apache Top-Level Project!
SeaTunnel GitHub repo: https://github.com/apache/incubator-seatunnel
What are some alternatives?
kestra - Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
airbyte - The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
bitsail - BitSail is a distributed high-performance data integration engine which supports batch, streaming and incremental scenarios. BitSail is widely used to synchronize hundreds of trillions of data every day.
hudi - Upserts, Deletes And Incremental Processing on Big Data.
Logstash - Logstash - transport and process your logs, events, or other data
apisix-docker - the docker for Apache APISIX
Apache Hive - Apache Hive