Top 23 Python AWS Projects
💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline!Project mention: Make onboarding simple using VS Code Remote Containers | dev.to | 2021-11-28
We use LocalStack for integration testing so we need to be able to run containers from within our dev container.
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.Project mention: Beginner in Python for Data Science | reddit.com/r/learnpython | 2020-12-27
data science ipython notebooks
Scout APM: A developer's best friend. Try free for 14-days. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.
Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview QuestionsProject mention: What language should I learn after Java and Python and how should I use my knowledge to learn about their applications in the real world? | reddit.com/r/computerscience | 2021-11-21
What about the applications in the real world? Github are the answer. Some weeks ago I found a repository where a list of ideas to create your technologies show: link. If you are lost, try to guide yourself through roadmaps. Or just search for exercises on GitHub about your profession. Example: DevOps Exercises.
Universal Command Line Interface for Amazon Web ServicesProject mention: Ask HN: What unexpected behaviors persist in software you use? | news.ycombinator.com | 2021-12-01
I just got bitten by a problem in AWS CLI where S3 files won't sync when you expect them to: https://github.com/aws/aws-cli/issues/3273
This got me thinking. What are the major unexpected behaviors, or "gotchas", exist in the software you use?
Where do you see the "Principle of Least Astonishment" violated? https://en.wikipedia.org/wiki/Principle_of_least_astonishment
I think we may all benefit from sharing with each other. Hopefully it'll save some of us from being bitten by odd software behavior.
I'm referring to tools, programming languages, database and server software, etc. I think it would be really useful to raise awareness of these issues.
A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.Project mention: There are 40,000+ quality AWS open source repositories on GitHub but are completely unorganized. I made a search engine and browser for all of them, all curated carefully with 1000+ filters. | reddit.com/r/sysadmin | 2021-06-06
There is also https://github.com/donnemartin/awesome-aws
Python Serverless Microframework for AWSProject mention: Full-length tutorial on deploying production-ready python REST API on AWS using chalice | reddit.com/r/flask | 2021-11-10
The playlist details how to deploy a production-ready python REST API on AWS using the chalice package. The playlist covers the following:
AWS Serverless Application Model (SAM) is an open-source framework for building serverless applicationsProject mention: Serverless AWS With Monorepos | dev.to | 2021-11-30
Amazon published SAM (Serverless Application Model) as a way of standardizing and easing Lambda development. SAM is an open-source framework that provides shorthand expressions for interacting with the AWS ecosystem. Not only can it deploy serverless functions, but it can also test them locally, debug them while running, access remote logs, and even help us perform canary deployments.
Run Linux Software Faster and Safer than Linux with Unikernels.
AWS SDK for PythonProject mention: The 3-2-1 Backup Rule – Why Your Data Will Always Survive | news.ycombinator.com | 2021-11-25
So it's 80% less service than S3, I see ))
In any case, thanks for mentioning the service. I'm quite happy with [Boto](https://github.com/boto/boto3) for interfacing with Glacier but it is good to know about alternatives.
An integrated shell for working with the AWS CLI.Project mention: MTurk Requester Notify-workers fails with endpoint URL error | reddit.com/r/mturk | 2021-06-03
If so the region config is explained here: https://github.com/awslabs/aws-shell#configuration
CLI tool to build, test, debug, and deploy Serverless applications using AWS SAMProject mention: Serverless AWS With Monorepos | dev.to | 2021-11-30
sem-version java 8 wget https://github.com/aws/aws-sam-cli/releases/latest/download/aws-sam-cli-linux-x86_64.zip unzip aws-sam-cli-linux-x86_64.zip -d sam-installation sudo ./sam-installation/install checkout cd java-app-backend cache restore build-java-app-backend-$SEMAPHORE_GIT_BRANCH sam deploy --no-confirm-changeset --stack-name serverless-web-application-java-backend --capabilities CAPABILITY_AUTO_EXPAND CAPABILITY_IAM
donnemartin - dev setup
A library that allows you to easily mock out tests based on AWS infrastructure.Project mention: How to handle cloud resources in your application while running localhost | reddit.com/r/devops | 2021-11-16
Ansible for DevOps examples.Project mention: How to iterate in a list within dictionary?? | reddit.com/r/ansible | 2021-10-14
You can also checkout Jeffs github https://github.com/geerlingguy/ansible-for-devops
A supercharged AWS command line interface (CLI).Project mention: What is the best program for making JSON CLI output more readable and manageable? | reddit.com/r/aws | 2021-11-01
I'd recommend giving https://github.com/donnemartin/saws a shot.
Rules engine for cloud security, cost optimization, and governance, DSL in yaml for policies to query, filter, and take actions on resourcesProject mention: GCP security best practices | dev.to | 2021-11-29
Luckily, cloud native security tools like Falco and Cloud Custodian can guide you through these Google Cloud Platform security best practices, and help you meet your compliance requirements.
Multi-Cloud Security Auditing ToolProject mention: Azure Environment Sanity Check | reddit.com/r/AZURE | 2021-10-13
Prevent cloud misconfigurations during build-time for Terraform, Cloudformation, Kubernetes, Serverless framework and other infrastructure-as-code-languages with Checkov by Bridgecrew.Project mention: Container security best practices: Comprehensive guide | dev.to | 2021-11-16
If you are using infrastructure as code, incorporate IaC scanning tools like Apolicy, Checkov, tfsec, or cfn_nag to validate the configuration of your infrastructure before it is created or updated. Similar to other linting tools, apply IaC scanning tools locally and in your pipeline, and consider blocking changes that introduce security issues.
🔎 Super-scale your images and run experiments with Residual Dense and Adversarial Networks.Project mention: What’s an extremely useful website most people probably don’t know about? | reddit.com/r/AskReddit | 2021-11-19
StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define.Project mention: Setting up lots of AWS alerts - make lots of SNS-SQS-Lambda chains? | reddit.com/r/devops | 2021-04-22
Repository for BLESS, an SSH Certificate Authority that runs as a AWS Lambda functionProject mention: Cryptojacking Attacks Continue To Target SSH Servers | reddit.com/r/netsec | 2021-07-23
The AWS exploitation framework, designed for testing the security of Amazon Web Services environments.Project mention: How do I build a network on AWS to capture flow data? | reddit.com/r/aws | 2021-11-16
Not related to your original question, but you might want to take a look at pacu for simulating attacks.
Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).Project mention: Redshift API vs. other ways to connect? | reddit.com/r/datascience | 2021-10-21
awslabs has developed their own package for this and given it's for their product, seem likely to maintain it. https://github.com/awslabs/aws-data-wrangler
A pythonic interface to Amazon's DynamoDBProject mention: A simple Python wrapper to AWS DynamoDB | reddit.com/r/aws | 2021-07-13
Genuine question - why would you choose this over https://github.com/pynamodb/PynamoDB ?
Python AWS related posts
Ask HN: Freelancer? Seeking freelancer? (December 2021)
3 projects | news.ycombinator.com | 1 Dec 2021
Serverless AWS With Monorepos
6 projects | dev.to | 30 Nov 2021
[D] Interactive Compute Platform Recommendations for ML Research
1 project | reddit.com/r/MachineLearning | 25 Nov 2021
The 3-2-1 Backup Rule – Why Your Data Will Always Survive
2 projects | news.ycombinator.com | 25 Nov 2021
IAM Least Privilege for IAM for SAM/CloudFormation?
1 project | reddit.com/r/aws | 24 Nov 2021
What language should I learn after Java and Python and how should I use my knowledge to learn about their applications in the real world?
1 project | reddit.com/r/computerscience | 21 Nov 2021
Data Exploration Quick Wins with VisiData
4 projects | dev.to | 21 Nov 2021
What are some of the best open-source AWS projects in Python? This list will help you:
|22||AWS Data Wrangler||2,321|
Are you hiring? Post a new remote job listing for free.