Reddit-API-Pipeline
aws-cdk
Reddit-API-Pipeline | aws-cdk | |
---|---|---|
7 | 264 | |
271 | 11,158 | |
- | 0.7% | |
0.0 | 9.9 | |
over 1 year ago | 7 days ago | |
Python | TypeScript | |
- | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Reddit-API-Pipeline
-
Reddit ELT Pipeline
P.S. I followed steps from this repository but made some adjustments: ABZ-Aaron/Reddit-API-Pipeline (github.com)
- Where can I find online projects end-to-end?
- I created a pipeline extracting Reddit data using Airflow, Docker, Terraform, S3, dbt, Redshift, and Google Data Studio
-
Do you think this AWS based personal project would be suitable and complex enough for a resume?
I recently created one using Airflow, Docker, dbt, S3, Redshift, and PowerBI. It's not perfect, and totally overkill with regards to the tools I used, but you can find it here: https://github.com/ABZ-Aaron/Reddit-API-Pipeline
- Is it worth me applying to Data Engineering roles with this Resume/CV?
aws-cdk
-
Pyinfra: Automate Infrastructure Using Python
https://github.com/aws/aws-cdk#at-a-glance is the "generate cloudformation using code," and is the AWS version of troposphere as best I can tell
-
Deploy Laravel API To AWS Lambda
environment: Specifies the environment variable that will be available to our Lambda function. In this case I wrote an environment for RDS Database. Anyway, later I will write about AWS CDK using Python for creating database clusters, etc.
-
Building an Amazon Location Service Resources with AWS CDK and AWS CloudFormation
Today, I will show you how to build Amazon Location Service, which allows you to build location-based applications within your AWS environment using AWS Cloud Development Kit (AWS CDK) and AWS CloudFormation. I will also show examples of the recently popular CDK Migrate and AWS CloudFormation IaC generator.
-
DevSecOps with AWS- IaC at scale - Building your own platform - Part 1
AWS Cloud Development Kit (CDK): is an open-source software development framework to define your cloud application resources using familiar programming languages.
-
Cloud, why so difficult? 🤷♀️
I am not one to build programming languages on a whim. In fact, I've spent the last five years building the AWS CDK, which is a multi-language library that addresses some of the challenges I am talking about by allowing developers to define cloud infrastructure using their favorite programming language.
-
Create a Next.js Server Component S3 Picture Uploader with SST
I recently started exploring SST as an alternative to my favorite full-stack set consisting of Projen, AWS CDK, and React. I have been thoroughly impressed with the experience so far. In this article, I will demonstrate how to create a Next.js App Router S3 Picture Uploader using SST.
-
Starting My AWS Certification Journey as a Certified Cloud Practitioner
AWS CDK
-
Cloud Garbage 🗑️
For KMS 🔑, Each key is ~$1/mo, and with CDK, keys are generated on a massive scale, if not centralized.
-
Building Serverless Applications On AWS: A Practical Guide To Managing Event Processing
Here is a github repository containing the code and instructions on how to automate this whole setup using AWS CDK.
-
How to Implement and Deploy a Smart Contract Event Listener with AWS CDK
Now that you have a working smart contract event listener, we'll deploy the resources to AWS using AWS CDK, which is an Infrastructure as Code (IaC) tool. AWS CDK allows you to configure, deploy, and manage AWS cloud resources using popular programming languages such as TypeScript.
What are some alternatives?
data-engineering-zoomcamp - Free Data Engineering course!
sst - Build modern full-stack applications on AWS
terraform-cdk - Define infrastructure resources using programming constructs and provision them using HashiCorp Terraform
aws-cdk-local - Thin wrapper script for using the AWS CDK CLI with LocalStack
versatile-data-kit - One framework to develop, deploy and operate data workflows with Python and SQL.
middy - 🛵 The stylish Node.js middleware engine for AWS Lambda 🛵
finnhub-streaming-data-pipeline - Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more
ts-node - TypeScript execution and REPL for node.js
audiophile-e2e-pipeline - Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard.
diy-sveltekit-cdk-adapter - An exercise on deploying SvelteKit with CDK
udacity-capstone
SvelteKit - web development, streamlined