dbt-synapse
analytics
| dbt-synapse | analytics | |
|---|---|---|
| 2 | 15 | |
| 64 | - | |
| - | - | |
| 9.0 | - | |
| 8 days ago | - | |
| Python | ||
| MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
dbt-synapse
-
How to load parquet files from Azure Data Lake Gen2/Azure Blob Storage to Dedicated pool using dbt?
I'm using dbt-synapse: https://github.com/dbt-msft/dbt-synapse
-
Can someone explain the big deal with dbt?
Have you tried dbt-synapse? I'm the maintainer and I'd love to hear what you think is missing. Also, w.r.t. dbt cloud support for Synapse -- it's something we're working on, but we're we need buy-in from MSFT first!
analytics
-
I'm not getting it...what's the point of DBT?
Take a look at gitlab's dbt project: https://gitlab.com/gitlab-data/analytics/-/blob/master/transform/snowflake-dbt/models/common/schema.yml
-
How would you structure a repo with 10+ ETL pipelines and shared code?
A good reference is the Gitlab data team repo. https://gitlab.com/gitlab-data/analytics
- What are your favourite GitHub repos that shows how data engineering should be done?
-
Are there any open corporate Data Team repositories / projects besides GitLab?
For example, their Data Team have a public repository, with a bunch of information on how they organize DAGs, machine learning projects, system configuration, etc.
- Kimball Dim Modelling Code Examples
- Can someone help me, an absolute newbie, understand the usage and benefit of dbt with practical example ?
-
Is jinja templating right for DBT?
So I've run through the DBT tutorial stuff and looked over some fairly complex uses of it i.e. GitLab Data and I was wondering if anyone has any opinions or insights into the use of jinja templating in the sql?
-
Where can I find free data engineering ( big data) projects online?
Gitlab has their DBT repo open source and is very useful for seeing how to structure a project at scale. https://gitlab.com/gitlab-data/analytics/-/tree/master/transform/snowflake-dbt
-
Gitlab's Data Team Platform (in depth look at their stack)
Currently the team is working hard on this: https://gitlab.com/gitlab-data/analytics/-/issues/9508
-
Can someone explain the big deal with dbt?
GitLab's dbt project is an excellent example of a mature project at scale. They also have a comprehensive guide to their methodology.
What are some alternatives?
datahub - The Metadata Platform for your Data Stack
dagster - An orchestration platform for the development, production, and observation of data assets.
dbt-external-tables - dbt macros to stage external sources
castled - Castled is an open source reverse ETL solution that helps you to periodically sync the data in your db/warehouse into sales, marketing, support or custom apps without any help from engineering teams
azure-sql-db-openai - Samples on how to use Azure SQL database with Azure OpenAI
azure-sql-hyperscale-autoscaler - Autoscaling Azure SQL Database Hyperscale with Azure Functions
AdvancedSQLPuzzles - Welcome to my GitHub repository. I hope you enjoy solving these puzzles as much as I have enjoyed creating them.
sqlglot - Python SQL Parser and Transpiler
lightdash - Self-serve BI to 10x your data team ⚡️
django-pyodbc-azure - Django backend for Microsoft SQL Server and Azure SQL Database using pyodbc
dbt-unit-testing - This dbt package contains macros to support unit testing that can be (re)used across dbt projects.