SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 AWS Open-Source Projects
-
devops-exercises
Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions
-
system-design-101
Explain complex systems using visuals and simple terms. Help you prepare for system design interviews.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
LocalStack
đź’» A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline
-
Previous Serverless Version 0.5.x
⚡ Serverless Framework – Use AWS Lambda and other managed cloud services to build apps that auto-scale, cost nothing when idle, and boast radically low maintenance.
-
data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
-
Pulumi
Pulumi - Infrastructure as Code in any programming language. Build infrastructure intuitively on any cloud using familiar languages 🚀
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
awesome-aws
A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.
-
terraformer
CLI tool to generate terraform files from existing infrastructure (reverse Terraform). Infrastructure to Code
-
prowler
Prowler is an Open Source Security tool for AWS, Azure, GCP and Kubernetes to do security assessments, audits, incident response, compliance, continuous monitoring, hardening and forensics readiness. Includes CIS, NIST 800, NIST CSF, CISA, FedRAMP, PCI-DSS, GDPR, HIPAA, FFIEC, SOC2, GXP, Well-Architected Security, ENS and more
-
amazon-sagemaker-examples
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠Amazon SageMaker.
-
go-cloud
The Go Cloud Development Kit (Go CDK): A library and tools for open cloud development in Go.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: What are some terrific blog posts on backend development and system design you have in your bookmarks and think everyone should read? (my example in the thread) | /r/ExperiencedDevs | 2023-11-28System Design 101 is an excellent resource.
Project mention: LocalStack – a functional local AWS cloud stack | news.ycombinator.com | 2024-04-05
Github | Website
We see some great results from using these in conjunction with frameworks such as SST or Serverless, and also some real spaghetti from people who organically proliferate 100’s of functions over time and lose track of how they relate to each other or how to update them safely across time and service. Buyer beware!
If you are following this blog series, you should already know the benefits of using Terraform to define and deploy your AWS resources and configuration. Other IaC solutions such as AWS CloudFormation, AWS CDK, and Pulumi work the same way but differs in the programming or configuration language.
When it came to deployment, I had several options, and I chose the hard way: deploying Kubernetes on bare metal nodes using KubeSpray. Troubleshooting bare metal Kubernetes deployments honed my skills in pinpointing issues. This hands-on experience provided a deep understanding of how each component, like the Control Plane, kubelet, Container Runtime, and scheduler, interacts to orchestrate containers.
My script just sets up default .sops.yaml for https://github.com/getsops/sops
You can further edit .sops.yaml(eg have multiple of them) and decide how you split secrets in your directory tree to further customize who can decrypt the secrets.
It works pretty well for prod/dev splits, etc
The AWS CLI is a must-have tool if your team relies on Amazon Web Services. It lets you effortlessly interact with AWS services, orchestrate resource management, and automate tasks from the comfort of your terminal. Once you get used to the tool, you'll notice how convenient and quick it is to fit into your processes – especially compared to going through AWS's web-based user interface.
Finally, I kinda wonder if CapRover is still alive. As I write this it has been over 60 days since there has been any activity on their GitHub.
‍Terraformer is a CLI tool developed by Google that generates Terraform files from existing infrastructure (reverse Terraform), simplifying the process of adopting Terraform in existing environments and speeding up the initial setup process. Terraformer supports multiple cloud providers, including AWS, Google Cloud, Azure, and others.
environment: Specifies the environment variable that will be available to our Lambda function. In this case I wrote an environment for RDS Database. Anyway, later I will write about AWS CDK using Python for creating database clusters, etc.
That looks similar to Chalice (also for Python)
https://github.com/aws/chalice
‍Infracost is a cost estimation tool that generates cost estimates for Terraform projects, which is crucial for budget planning and cost optimization, especially in cloud environments where resource costs can vary significantly.
Project mention: Ask HN: Cloud security auditing for indie-grade projects? | news.ycombinator.com | 2023-12-04Which cloud provider?
https://github.com/prowler-cloud/prowler is easy to get going with, and gives decent results. It's much stronger at AWS than GCP or Azure.
Steampipe can be a little harder to wrap your head around, but scales really well and has broader support: https://hub.steampipe.io/mods?objectives=security
I need to use AWS Sagemaker (required, can't use easier services) and my adviser gave me this document to start with: https://github.com/aws/amazon-sagemaker-examples/blob/main/introduction_to_amazon_algorithms/jumpstart-foundation-models/question_answering_retrieval_augmented_generation/question_answering_langchain_jumpstart.ipynb
For Terraform, instead, a new version of the AWS module supports a dedicated resource.
— https://github.com/milanm/DevOps-Roadmap
Even when going multi-cloud you can employ different strategies. Vault is definitely one of them, but you can also use federation to exchange one cloud's credentials for another's, giving you the ability to centralize secrets in one of them. You can use a layer of abstraction like GoCloud [0]. You can also build for each cloud separately and decide either not to centralize secrets at all, or build some trivial bespoke tooling to synchronize some of them. I'm not endorsing any of the options, just pointing out that Vault isn't the only one.
https://github.com/google/go-cloud
AWS related posts
- Despliega una Infraestructura de Red AWS Robusta con Terraform
- Deploying a Containerized App to ECS Fargate Using a Private ECR Repo & Terragrunt
- Runhouse
- Pico.sh – Hacker Labs
- AWS EKS: From IRSA to Pod Identity With Terraform
- Terraform vs. AWS CloudFormation
- Adding Cognito Authentication to our Serverless Dash App
-
A note from our sponsor - SaaSHub
www.saashub.com | 23 Apr 2024
Index
What are some of the best open-source AWS projects? This list will help you:
Project | Stars | |
---|---|---|
1 | devops-exercises | 63,339 |
2 | system-design-101 | 56,595 |
3 | LocalStack | 52,055 |
4 | Previous Serverless Version 0.5.x | 46,050 |
5 | data-science-ipython-notebooks | 26,459 |
6 | sst | 19,951 |
7 | Pulumi | 19,705 |
8 | kubespray | 15,328 |
9 | sops | 15,069 |
10 | aws-cli | 14,867 |
11 | awesome-kubernetes | 14,715 |
12 | awesome-aws | 12,147 |
13 | CapRover | 12,140 |
14 | terraformer | 11,742 |
15 | aws-cdk | 11,137 |
16 | cas | 10,629 |
17 | chalice | 10,293 |
18 | infracost | 10,239 |
19 | prowler | 9,514 |
20 | amazon-sagemaker-examples | 9,491 |
21 | terraform-provider-aws | 9,443 |
22 | DevOps-Roadmap | 9,413 |
23 | go-cloud | 9,380 |
Sponsored