Reddit-API-Pipeline
Pulumi
| Reddit-API-Pipeline | Pulumi | |
|---|---|---|
| 7 | 178 | |
| 271 | 19,876 | |
| - | 2.4% | |
| 0.0 | 9.9 | |
| over 1 year ago | 4 days ago | |
| Python | Go | |
| - | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Reddit-API-Pipeline
-
Reddit ELT Pipeline
P.S. I followed steps from this repository but made some adjustments: ABZ-Aaron/Reddit-API-Pipeline (github.com)
- Where can I find online projects end-to-end?
- I created a pipeline extracting Reddit data using Airflow, Docker, Terraform, S3, dbt, Redshift, and Google Data Studio
-
Do you think this AWS based personal project would be suitable and complex enough for a resume?
I recently created one using Airflow, Docker, dbt, S3, Redshift, and PowerBI. It's not perfect, and totally overkill with regards to the tools I used, but you can find it here: https://github.com/ABZ-Aaron/Reddit-API-Pipeline
- Is it worth me applying to Data Engineering roles with this Resume/CV?
Pulumi
-
How To Implement AWS SSB Controls in Terraform - Part 4
If you are following this blog series, you should already know the benefits of using Terraform to define and deploy your AWS resources and configuration. Other IaC solutions such as AWS CloudFormation, AWS CDK, and Pulumi work the same way but differs in the programming or configuration language.
-
The 2024 Web Hosting Report
Infrastructure as Code (IaC) is an important part of any true hosting operation in the public cloud. Each of these platforms has their own IaC solution, e.g. AWS CloudFormation. But they also support popular open-source IaC tools like Pulumi or Terraform. A category of tools that also needs to be discussed is API gateways and other app-specific load balancers. There are applications for internal consumption, which can be called microservices if you have a lot of them. And often microservices use advanced networking options such as a service mesh instead of just the native private network offered by a VPC.
-
systemd by example (2021)
funny, to me systemd == no docker, no containers, just a VM.
it's my goto way to keep my programming running and have it be restarted if the vm reboots. I use VMs like "pods". I deploy code directly to the VM and run it there along with other programs. I scale up an scale down with: https://www.pulumi.com/
-
A list of SaaS, PaaS and IaaS offerings that have free tiers of interest to devops and infradev
Pulumi — Modern infrastructure as a code platform that allows you to use familiar programming languages and tools to build, deploy, and manage cloud infrastructure.
-
Playing devil's advocate with Terraform
A move like this may have an impact in other open source projects. Take Pulumi, for instance, people might avoid choosing it now that the Linux Foundation have its own IaC tool, and for newer, smaller projects it will probably be impossible to compete with a project under the Linux name.
- Pulumi – open-source Infrastructure as Code in any language
-
Best way to deploy K8s to single VPS for dev environment
Another alternative to writing an operator would be to rely on kustomize or https://www.pulumi.com/.
-
⚡⚡ Level Up Your Cloud Experience with These 7 Open Source Projects 🌩️
Pulumi
-
Show HN: Togomak – declarative pipeline orchestrator based on HCL and Terraform
Would it make sense to say Dagger is to Pulumi [1], as Terraform is to Togomak?
[1]: https://www.pulumi.com/
-
The Complete Microservices Guide
Infrastructure as Code (IaC): Define your infrastructure using code (IaC) to automate the provisioning of resources such as virtual machines, load balancers, and databases. Tools like Terraform, Pulumi, and AWS CloudFormation can help.
What are some alternatives?
data-engineering-zoomcamp - Free Data Engineering course!
terraform-cdk - Define infrastructure resources using programming constructs and provision them using HashiCorp Terraform
cdk8s - Define Kubernetes native apps and abstractions using object-oriented programming
versatile-data-kit - One framework to develop, deploy and operate data workflows with Python and SQL.
terragrunt - Terragrunt is a thin wrapper for Terraform that provides extra tools for working with multiple Terraform modules.
finnhub-streaming-data-pipeline - Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more
crossplane - The Cloud Native Control Plane
audiophile-e2e-pipeline - Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard.
bicep - Bicep is a declarative language for describing and deploying Azure resources
udacity-capstone
Ansible - Ansible is a radically simple IT automation platform that makes your applications and systems easier to deploy and maintain. Automate everything from code deployment to network configuration to cloud management, in a language that approaches plain English, using SSH, with no agents to install on remote systems. https://docs.ansible.com.