Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 23 AWS Open-Source Projects
-
devops-exercises
Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions
-
system-design-101
Explain complex systems using visuals and simple terms. Help you prepare for system design interviews.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
LocalStack
💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline
-
Previous Serverless Version 0.5.x
⚡ Serverless Framework – Use AWS Lambda and other managed cloud services to build apps that auto-scale, cost nothing when idle, and boast radically low maintenance.
-
data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
-
-
Pulumi
Pulumi - Infrastructure as Code in any programming language. Build infrastructure intuitively on any cloud using familiar languages 🚀
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
-
-
-
awesome-aws
A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.
-
terraformer
CLI tool to generate terraform files from existing infrastructure (reverse Terraform). Infrastructure to Code
-
-
-
-
-
prowler
Prowler is an Open Source Security tool for AWS, Azure, GCP and Kubernetes to do security assessments, audits, incident response, compliance, continuous monitoring, hardening and forensics readiness. Includes CIS, NIST 800, NIST CSF, CISA, FedRAMP, PCI-DSS, GDPR, HIPAA, FFIEC, SOC2, GXP, Well-Architected Security, ENS and more
-
amazon-sagemaker-examples
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
-
-
go-cloud
The Go Cloud Development Kit (Go CDK): A library and tools for open cloud development in Go.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: What are some terrific blog posts on backend development and system design you have in your bookmarks and think everyone should read? (my example in the thread) | /r/ExperiencedDevs | 2023-11-28System Design 101 is an excellent resource.
Project mention: LocalStack – a functional local AWS cloud stack | news.ycombinator.com | 2024-04-05
Github | Website
We see some great results from using these in conjunction with frameworks such as SST or Serverless, and also some real spaghetti from people who organically proliferate 100’s of functions over time and lose track of how they relate to each other or how to update them safely across time and service. Buyer beware!
If you are following this blog series, you should already know the benefits of using Terraform to define and deploy your AWS resources and configuration. Other IaC solutions such as AWS CloudFormation, AWS CDK, and Pulumi work the same way but differs in the programming or configuration language.
When it came to deployment, I had several options, and I chose the hard way: deploying Kubernetes on bare metal nodes using KubeSpray. Troubleshooting bare metal Kubernetes deployments honed my skills in pinpointing issues. This hands-on experience provided a deep understanding of how each component, like the Control Plane, kubelet, Container Runtime, and scheduler, interacts to orchestrate containers.
My script just sets up default .sops.yaml for https://github.com/getsops/sops
You can further edit .sops.yaml(eg have multiple of them) and decide how you split secrets in your directory tree to further customize who can decrypt the secrets.
It works pretty well for prod/dev splits, etc
The AWS CLI is a must-have tool if your team relies on Amazon Web Services. It lets you effortlessly interact with AWS services, orchestrate resource management, and automate tasks from the comfort of your terminal. Once you get used to the tool, you'll notice how convenient and quick it is to fit into your processes – especially compared to going through AWS's web-based user interface.
Finally, I kinda wonder if CapRover is still alive. As I write this it has been over 60 days since there has been any activity on their GitHub.
Terraformer is a CLI tool developed by Google that generates Terraform files from existing infrastructure (reverse Terraform), simplifying the process of adopting Terraform in existing environments and speeding up the initial setup process. Terraformer supports multiple cloud providers, including AWS, Google Cloud, Azure, and others.
https://github.com/aws/aws-cdk#at-a-glance is the "generate cloudformation using code," and is the AWS version of troposphere as best I can tell
Project mention: Superpower REST API DX with Serverless ⚡ and DevOps Best Practices on AWS (🐍 Python Version) | dev.to | 2024-04-30If you want to write serverless apps with Python without using Serverless Framework, you can ship them with Chalice.
Infracost is a cost estimation tool that generates cost estimates for Terraform projects, which is crucial for budget planning and cost optimization, especially in cloud environments where resource costs can vary significantly.
— https://github.com/milanm/DevOps-Roadmap
1. Prowler: https://github.com/prowler-cloud/prowler Prowler provides security best practices assessments, audits, incident response readiness, and continuous monitoring for AWS environments.
I need to use AWS Sagemaker (required, can't use easier services) and my adviser gave me this document to start with: https://github.com/aws/amazon-sagemaker-examples/blob/main/introduction_to_amazon_algorithms/jumpstart-foundation-models/question_answering_retrieval_augmented_generation/question_answering_langchain_jumpstart.ipynb
API for IaaC: At least for Pulumi, it appears not all IPv6 settings are configurable. For example, I could not retrieve IPv6 automatically in the same way as IPv4 via Elastic IP, or I could not configure ICMPv6 ACL (a similar issue is reported in the Terraform repository).
Even when going multi-cloud you can employ different strategies. Vault is definitely one of them, but you can also use federation to exchange one cloud's credentials for another's, giving you the ability to centralize secrets in one of them. You can use a layer of abstraction like GoCloud [0]. You can also build for each cloud separately and decide either not to centralize secrets at all, or build some trivial bespoke tooling to synchronize some of them. I'm not endorsing any of the options, just pointing out that Vault isn't the only one.
https://github.com/google/go-cloud
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
AWS related posts
-
Phidata: Add memory, knowledge and tools to LLMs
-
How to Manage Multiple Terraform Environments Efficiently
-
E1s – A Terminal-Based AWS ECS Management Tool(~K9s for ECS)
-
Maximizing the Use of EC2 Instance Connect Endpoint with CDK
-
Eliminate IPv4 tax on AWS, is it that easy?
-
OPA, Cedar, OpenFGA: Why are Policy Languages Trending Right Now?
-
How To Manage an Amazon Bedrock Agent Using Terraform
-
A note from our sponsor - InfluxDB
www.influxdata.com | 8 May 2024
Index
What are some of the best open-source AWS projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | devops-exercises | 63,708 |
| 2 | system-design-101 | 57,017 |
| 3 | LocalStack | 52,204 |
| 4 | Previous Serverless Version 0.5.x | 46,096 |
| 5 | data-science-ipython-notebooks | 26,514 |
| 6 | sst | 20,214 |
| 7 | Pulumi | 19,976 |
| 8 | kubespray | 15,391 |
| 9 | sops | 15,160 |
| 10 | aws-cli | 14,897 |
| 11 | awesome-kubernetes | 14,743 |
| 12 | CapRover | 12,220 |
| 13 | awesome-aws | 12,174 |
| 14 | terraformer | 11,797 |
| 15 | aws-cdk | 11,177 |
| 16 | cas | 10,655 |
| 17 | chalice | 10,312 |
| 18 | infracost | 10,289 |
| 19 | DevOps-Roadmap | 9,592 |
| 20 | prowler | 9,571 |
| 21 | amazon-sagemaker-examples | 9,512 |
| 22 | terraform-provider-aws | 9,467 |
| 23 | go-cloud | 9,395 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com