fragments
dataform
fragments | dataform | |
---|---|---|
2 | 1 | |
14 | 793 | |
- | 1.3% | |
2.8 | 9.2 | |
10 months ago | about 19 hours ago | |
TypeScript | TypeScript | |
- | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fragments
-
Fetch and transform data from a source and expose a REST API
I built this https://github.com/corpulent/fragments as an experiment/POC for fetching and transforming data from various sources and exposing it via a REST API for consumption in BI dashboards, apps, and so on. Jinja defines the structure a REST API should return, users can write custom functions to transform data. Data gets optionally cached after its processed the first time so consecutive API calls are instant. Jinja is optional, and users can just write Python code.
GraphQL is a similar idea to this.
I am burned out trying to figure out good use cases, a market to approach, and generally in what ways to expand on it further. So I am reaching out to the community in hopes of gaining some insights or ideas!
Thanks in advance.
-
Sharing my data engineering project/idea, using jinja, docker, k8s, react UI.
Repo here https://github.com/corpulent/fragments
dataform
-
Monorepo build system
Here's ours if you want some inspiration and examples - https://github.com/dataform-co/dataform
What are some alternatives?
turnilo - Business intelligence, data exploration and visualization web application for Druid, formerly known as Swiv and Pivot
dagster - An orchestration platform for the development, production, and observation of data assets.
optimus - Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
sayn - Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).
faros-community-edition - BI, API and Automation layer for your Engineering Operations data
typescript-monorepo-example
lightdash - Self-serve BI to 10x your data team ⚡️
pipebird - Pipebird is open source infrastructure for securely sharing data with customers.
superset - Apache Superset is a Data Visualization and Data Exploration Platform
Grafana - The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.
nx - Smart Monorepos · Fast CI