Reddit-API-Pipeline
terraform-cdk
Reddit-API-Pipeline | terraform-cdk | |
---|---|---|
7 | 104 | |
271 | 4,727 | |
- | 0.6% | |
0.0 | 9.8 | |
over 1 year ago | 4 days ago | |
Python | TypeScript | |
- | Mozilla Public License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Reddit-API-Pipeline
-
Reddit ELT Pipeline
P.S. I followed steps from this repository but made some adjustments: ABZ-Aaron/Reddit-API-Pipeline (github.com)
- Where can I find online projects end-to-end?
- I created a pipeline extracting Reddit data using Airflow, Docker, Terraform, S3, dbt, Redshift, and Google Data Studio
-
Do you think this AWS based personal project would be suitable and complex enough for a resume?
I recently created one using Airflow, Docker, dbt, S3, Redshift, and PowerBI. It's not perfect, and totally overkill with regards to the tools I used, but you can find it here: https://github.com/ABZ-Aaron/Reddit-API-Pipeline
- Is it worth me applying to Data Engineering roles with this Resume/CV?
terraform-cdk
-
Learning Go by examples: part 12 - Deploy Go apps in Go with CDK for Terraform (CDKTF)
At first I tested it to deploy an OVHcloud Managed Kubernetes Service (MKS) with a Node Pool. And step by step, it worked. I even created a Pull Request (PR) in the terraform-cdk repository to add it as an example βΊοΈ.
-
AWS CDK For Noobs: Deploying NextJS Apps
I'll be trying more sample app deployments with CDK and maybe even explore CDK for Terraform.
-
Show HN: Winglang β a new Cloud-Oriented programming language
You can use CDK with other providers using https://github.com/hashicorp/terraform-cdk
In my experience, CDK is far better than Pulumi, especially if you're mostly going to be using AWS.
- Terraform CDK
-
Why is Kubernetes adoption so hard?
I, personally, prefer Crossplane Composite Functions on top of CDK8S, but had dropped CDKTF due to bloat. You can actually manage Kubernetes updates/upgrade lifecycle with Crossplane, as well.
- Cloud, Why So Difficult?
- What are some harsh truths that r/devops needs to hear?
-
Backend engineers that don't like JavaScript
I was going to recommend Pulumi, but looks like CDK for Terraform is still being kept up to date.
-
Should i migrate from Kustomize to Helm?
Avoid Pulumi, get directly to source and use https://github.com/hashicorp/terraform-cdk
- AWS IAM Roles, a tale of unnecessary complexity
What are some alternatives?
data-engineering-zoomcamp - Free Data Engineering course!
Pulumi - Pulumi - Infrastructure as Code in any programming language. Build infrastructure intuitively on any cloud using familiar languages π
versatile-data-kit - One framework to develop, deploy and operate data workflows with Python and SQL.
terragrunt - Terragrunt is a thin wrapper for Terraform that provides extra tools for working with multiple Terraform modules.
finnhub-streaming-data-pipeline - Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more
crossplane - The Cloud Native Control Plane
audiophile-e2e-pipeline - Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard.
copilot-cli - The AWS Copilot CLI is a tool for developers to build, release and operate production ready containerized applications on AWS App Runner or Amazon ECS on AWS Fargate.
udacity-capstone
cdk8s - Define Kubernetes native apps and abstractions using object-oriented programming
surf_dash
aws-cdk-local - Thin wrapper script for using the AWS CDK CLI with LocalStack