Dbt-external-tables Alternatives

dbt-external-tables reviews and mentions

• [Need feedback] I wrote a guide about the fundamentals of BigQuery for software developers & traditional database users
  4 projects | /r/dataengineering | 14 Apr 2023

  You can setup your CDC process such that it will create and evolve the tables for you, e.g. by using jdbc connector. So the moment your OLTP database schema changes, it gets picked up by the CDC process and it will propagate it to your OLAP database. If you want to have more control over schema evolution, you can also do it in dbt using dbt-external-tables package.

• How to write raw ingestion code when working with dbt?
  2 projects | /r/dataengineering | 17 Feb 2023

  This looks like what is done by https://github.com/dbt-labs/dbt-external-tables/blob/main/sample_sources/snowflake.yml right ?

• Personal Project: Beginner seeking advice for Spotify streams project
  1 project | /r/dataengineering | 14 Feb 2023

  If you are familiar with dbt, it should be straightforward to do this using dbt and dbt-external-tables.

• CDC Implementation
  2 projects | /r/dataengineering | 12 Feb 2023

  We keep track of the schema in git using dbt-external-tables. If a new column is added upstream, whoever made the change is responsible for updating the schema in dbt. It's just a few lines of code. Once PR is merged, the external table that reads the S3 files is refreshed. We never remove columns.

• What is in your Data Stack? - Thread
  1 project | /r/dataengineering | 1 Aug 2022

  In addition to the built-in seed command you can also install this package called dbt-external-tables which will automate the creation of pointers/views to external data sources living on S3/GCS/Azure Blob Storage for several data warehouses. Then you can simply select from these external sources when building your models.

• How to load parquet files from Azure Data Lake Gen2/Azure Blob Storage to Dedicated pool using dbt?
  2 projects | /r/dataengineering | 20 Mar 2022
• Data Pipelines With DBT (Data Build Tool) in Azure
  1 project | /r/dataengineering | 15 Mar 2021

  For the external tables, I'm using the following plugin: https://github.com/fishtown-analytics/dbt-external-tables

• A note from our sponsor - InfluxDB
  www.influxdata.com | 26 Apr 2024

  Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →