Reddit-API-Pipeline
audiophile-e2e-pipeline
| Reddit-API-Pipeline | audiophile-e2e-pipeline | |
|---|---|---|
| 7 | 3 | |
| 271 | 170 | |
| - | - | |
| 0.0 | 0.0 | |
| over 1 year ago | over 1 year ago | |
| Python | Python | |
| - | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Reddit-API-Pipeline
-
Reddit ELT Pipeline
P.S. I followed steps from this repository but made some adjustments: ABZ-Aaron/Reddit-API-Pipeline (github.com)
- Where can I find online projects end-to-end?
- I created a pipeline extracting Reddit data using Airflow, Docker, Terraform, S3, dbt, Redshift, and Google Data Studio
-
Do you think this AWS based personal project would be suitable and complex enough for a resume?
I recently created one using Airflow, Docker, dbt, S3, Redshift, and PowerBI. It's not perfect, and totally overkill with regards to the tools I used, but you can find it here: https://github.com/ABZ-Aaron/Reddit-API-Pipeline
- Is it worth me applying to Data Engineering roles with this Resume/CV?
audiophile-e2e-pipeline
- Where can I find online projects end-to-end?
-
Celebrating my first Data Engineering Project -- Fitbit data with PySpark, GCP, prefect, and terraform!
ris-tlp adiophile-e2e-pipeline
- Built and automated a complete end-to-end ELT pipeline using AWS, Airflow, dbt, Terraform, Metabase and more as a beginner project!
What are some alternatives?
data-engineering-zoomcamp - Free Data Engineering course!
terraform-cdk - Define infrastructure resources using programming constructs and provision them using HashiCorp Terraform
ghcn-d - Data Pipeline from the Global Historical Climatology Network DataSet
versatile-data-kit - One framework to develop, deploy and operate data workflows with Python and SQL.
data_engineering_project_1 - My first attempt at a rough ETL pipeline; technologies include spark, GCS, prefect orchestration, and terraform
finnhub-streaming-data-pipeline - Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more
stream-iot - An end-to-end workflow for processing streaming data on Azure.
udacity-capstone
StravaDataPipline - :arrows_counterclockwise: :running: EtLT of my own Strava data using the Strava API, MySQL, Python, S3, Redshift, and Airflow
surf_dash
streamify - A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!