SaaSHub helps you find the best software and product alternatives Learn more →
Top 21 data-modeling Open-Source Projects
-
dbt-core
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
-
Udacity-Data-Engineering-Projects
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
data-engineering-wiki
The best place to learn data engineering. Built and maintained by the data engineering community.
-
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
hof
Framework that joins data models, schemas, code generation, and a task engine. Language and technology agnostic.
-
-
-
awesome-database-design
:zap: A collection of resources and tutorials to design a better database schema.
-
tellery
Tellery lets you build metrics using SQL and bring them to your team. As easy as using a document. As powerful as a data modeling tool.
-
-
sayn
Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).
-
uber-expenses-tracking
The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.
-
-
malloy-vscode-extension
The Malloy Visual Studio Code extension facilitates building Malloy data models, querying and transforming data, and creating simple visualizations and dashboards
-
-
SEIQHCDRO-Interactive-Model
Interactive website that takes different scenarios to predict COVID outcomes in different areas. Featured on Forbes Under 30 Vietnam 2021.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: What direction can I take to mocking a data structure that is relational on the front-end while I wait for backend endpoints to be created? | /r/Frontend | 2023-12-09
Project mention: Quary: Rust-based data transformation alternative to DBT | news.ycombinator.com | 2024-02-21
Project mention: Ask HN: Are SQL developers generally familiar with JSON, VSCode and Docker? | news.ycombinator.com | 2024-03-14Many business analysts use SQL, have for a long time. They are probably not your target audience. With the problem being JAVA specific, you'd likely want to start there
This sounds similar to the goals of my hof tool (https://github.com/hofstadter-io/hof), lift type definitions out of code so they can be defined in one place, then generate the code for all the places. Is that sounding like what you are after?
Project mention: Loops: journeys in declarative logic programming in genomics [video] | news.ycombinator.com | 2023-11-30LinkML that Chris presents here looks really interesting though!
https://linkml.io/
https://github.com/linkml/linkml
Glad you asked! It is certainly usable for writing apps. We publish an npm package, and the Malloy VSCode extension [0] is one such example of an app built on top of it. There's also a demo of a toy CLI app that showcases the simplest possible use of the API: https://github.com/malloydata/malloy-demo-bq-cli
Fair critique on the presentation. That's mostly a function of the circles I run in, which is heavily weighted towards data analysts, data engineers and "analytics engineers". But to your point, I think that cohort is unlikely to be early adopters of a tool like Malloy, and that developers are a much easier sell.
[0]: https://github.com/malloydata/malloy-vscode-extension
Project mention: Show HN: Kafka lowcode/nocode: RDF as streaming pipeline aurotmation | news.ycombinator.com | 2023-08-01
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
data-modeling related posts
- Ask HN: Are SQL developers generally familiar with JSON, VSCode and Docker?
- Dbt
- TSDiagram – Make Diagrams with TypeScript
- TSDiagram - Diagrams as code with TypeScript
- Show HN: TSDiagram – Diagrams as Code with TypeScript
- Show HN: TSDiagram – Diagrams as Code with TypeScript
- How to Level Up Beyond ETLs: From Query Optimization to Code Generation
-
A note from our sponsor - SaaSHub
www.saashub.com | 25 Apr 2024
Index
What are some of the best open-source data-modeling projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | dbt-core | 8,881 |
| 2 | Udacity-Data-Engineering-Projects | 1,295 |
| 3 | metricflow | 1,069 |
| 4 | data-engineering-wiki | 1,027 |
| 5 | data | 746 |
| 6 | Data-Engineering-Projects | 637 |
| 7 | quary | 570 |
| 8 | hof | 475 |
| 9 | postgresDBSamples | 414 |
| 10 | dry-struct | 402 |
| 11 | tsdiagram | 380 |
| 12 | ActivitySchema | 373 |
| 13 | awesome-database-design | 354 |
| 14 | tellery | 351 |
| 15 | linkml | 275 |
| 16 | sayn | 117 |
| 17 | uber-expenses-tracking | 94 |
| 18 | irelia | 45 |
| 19 | malloy-vscode-extension | 10 |
| 20 | kolle | 9 |
| 21 | SEIQHCDRO-Interactive-Model | 8 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com