f1-data-pipeline
steam-data-engineering
f1-data-pipeline | steam-data-engineering | |
---|---|---|
1 | 1 | |
23 | 20 | |
- | - | |
6.8 | 10.0 | |
10 months ago | over 1 year ago | |
Python | Python | |
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
f1-data-pipeline
steam-data-engineering
-
Feedback for my project about Steam games data, featuring Terraform, Airflow, dbt, spark, dataproc, Bigquery, S3, etc
Here is the GH repo: https://github.com/VicenteYago/steam-data-engineering with more detailed info.
What are some alternatives?
dbt2looker - Generate lookml for views from dbt models
magic-the-gathering - A complete pipeline to pull data from Scryfall's "Magic: The Gathering"-API, via Prefect orchestration and dbt transformation.
astro - Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow. [Moved to: https://github.com/astronomer/astro-sdk]
ComputerMonitoring_IOT - Uses Python to pull computer statistics and stores data to BigQuery using Pub/Sub, Cloud Functions.
ghcn-d - Data Pipeline from the Global Historical Climatology Network DataSet
weather_data_pipeline - This is a PySpark-based data pipeline that fetches weather data for a few cities, performs some basic processing and transformation on the data, and then writes the processed data to a Google Cloud Storage bucket and a BigQuery table.The data is then viewed in a looker dashboard
data-engineering-zoomcamp - Free Data Engineering course!
prefect-deployment-patterns - Code examples showing flow deployment to various types of infrastructure
dbt-coves - CLI tool for dbt users to simplify creation of staging models (yml and sql) files
astro-sdk - Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.