Python AWS

Open-source Python projects categorized as AWS

Top 23 Python AWS Projects

  • LocalStack

    💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline!

    Project mention: Localstack Overview with DynamoDB | dev.to | 2022-10-25

    Localstack is a cloud service emulator. It gives you a mock local AWS setup that you can use for testing and development instead of using an actual cloud service. In this post, we'll be setting up Localstack and writing some go code using the AWS SDK to create a DynamoDB table inside of our Localstack environment, populate the table with fake data and get all the data from the table.

  • devops-exercises

    Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions

    Project mention: Mgrate to devops | reddit.com/r/devops | 2022-11-18

    That's fair wack of experience so I don't know what you don't know but try and have a glance through https://github.com/bregman-arie/devops-exercises and pick some areas you don't know and start there.

  • InfluxDB

    Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Data Platform where developers build real-time applications for analytics, IoT and cloud-native services in less time with less code.

  • data-science-ipython-notebooks

    Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

  • aws-cli

    Universal Command Line Interface for Amazon Web Services

    Project mention: 3 Tips to Dramatically Improve S3 Transfer Speeds | dev.to | 2022-11-03

    [1] https://github.com/aws/aws-cli/blob/2.8.8/CHANGELOG.rst

  • awesome-aws

    A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

  • chalice

    Python Serverless Microframework for AWS

    Project mention: Looking for a good developer workflow with private pip packages | reddit.com/r/learnpython | 2022-07-28

    I'm working with AWS Chalice. It's a Python framework that deploys to lambdas, though it has its share of quirks/issues.

  • serverless-application-model

    The AWS Serverless Application Model (AWS SAM) transform is a AWS CloudFormation macro that transforms SAM templates into CloudFormation templates.

    Project mention: Serverless - what should I have thought about? | dev.to | 2022-11-18

    AWS Serverless Application Model (SAM)

  • Sonar

    Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  • boto3

    AWS SDK for Python

    Project mention: Advice for interacting with various technologies (REST vs PowerShell, Bash, and Python for scripting) | reddit.com/r/sysadmin | 2022-11-16

    I suppose you're saying you have been using prebuilt language libraries to interact with APIs, like Boto for AWS with Python. But now you want to use REST calls directly, or write your own in-house library.

  • aws-shell

    An integrated shell for working with the AWS CLI.

    Project mention: Why can't I use grep on AWS CLI output? | reddit.com/r/aws | 2022-10-29

    AWS-shell is super handy for learning the CLI.

  • ansible-for-devops

    Ansible for DevOps examples.

  • Moto

    A library that allows you to easily mock out tests based on AWS infrastructure.

    Project mention: Do some developers actually, REALLY, have no local environment and run everything in AWS? Is the individual cloud dev environment a real alternative to having things running locally? | reddit.com/r/aws | 2022-10-20

    You should be able to unit test your application on any device. (I use moto to help there.) And then when you want to ensure that you've given your lambda the right security groups or whatever, you deploy to a real but non-production lambda, and that deployment can be from anywhere.

  • aws-sam-cli

    CLI tool to build, test, debug, and deploy Serverless applications using AWS SAM

    Project mention: Completing the Cloud Resume Challenge with 0 Real-world Experience | dev.to | 2022-08-30

    Mostly due to lack of proper documentation it was difficult to get the HTTPApi syntax correct. The yaml file is very picky for CORS configuration on an HTTPApi. Luckily I found this github issue which allowed me to troubleshoot my yaml file.

  • dev-setup

    macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

    Project mention: Automate Mac setup? | reddit.com/r/macsysadmin | 2022-04-10

    Something like this at least is the most direct answer to your question, as opposed to "you're doing it wrong" which unfortunately seems to be more upvoted. An example of something like this might be https://github.com/donnemartin/dev-setup

  • SAWS

    A supercharged AWS command line interface (CLI).

  • checkov

    Prevent cloud misconfigurations and find vulnerabilities during build-time in infrastructure as code, container images and open source packages with Checkov by Bridgecrew.

    Project mention: SBOM with Checkov | dev.to | 2022-11-25

    Well, yes, Checkov is a quality scanner, but from some time already it is more than that! Let's see on the frameworks which can be scanned by Checkov:

  • ScoutSuite

    Multi-Cloud Security Auditing Tool

    Project mention: Scanning for AWS Security Issues with Trivy | news.ycombinator.com | 2022-08-16
  • cloud-custodian

    Rules engine for cloud security, cost optimization, and governance, DSL in yaml for policies to query, filter, and take actions on resources

    Project mention: Tag Enforcement | reddit.com/r/aws | 2022-11-07

    Cloud custodian is a good utility if config rules doesn’t satisfy your needs. It’s also cross platform.

  • image-super-resolution

    🔎 Super-scale your images and run experiments with Residual Dense and Adversarial Networks.

    Project mention: Low quality surveillance footage from a hit and run that happened today. Greatly appreciate if anyone has any ideas on how to get the plate number. | reddit.com/r/computervision | 2022-08-20
  • AWS Data Wrangler

    pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

    Project mention: I agree that Arrow Tables are great, but we decided to keep the library focused on the Pandas interface. [wont implement] | reddit.com/r/programmingcirclejerk | 2022-09-21
  • gluonts

    Probabilistic time series modeling in Python

    Project mention: Cash-flow forecasting | reddit.com/r/datascience | 2022-10-07

    -GluonTS

  • pacu

    The AWS exploitation framework, designed for testing the security of Amazon Web Services environments.

    Project mention: Should I be afraid of aws cloud as a security analyst? | reddit.com/r/cybersecurity | 2022-02-23

    ScoutSuite and Pacu (or Lava for Azure) are great tools and it's worth learning what they can do.

  • consoleme

    A Central Control Plane for AWS Permissions and Access

    Project mention: AWS IAM Roles, a tale of unnecessary complexity | news.ycombinator.com | 2022-11-11

    This is the way. I’ve seen this happen countless times. It’s happened to me too. It’s happened to colleagues.

    The worst case I’m aware of from first-hand knowledge was a large cluster of resources that got deployed for a product demo by a sales engineer and forgotten about. Turned into a nice ~$100,000 surprise in the quarterly budget.

    Netflix built a tool for managing IAM permission requests as an auditable workflow, called ConsoleMe: https://github.com/Netflix/consoleme

  • streamalert

    StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define.

  • Zigi

    The context switching struggle is real. Zigi makes context switching a thing of the past. It monitors Jira and GitHub updates, pings you when PRs need approval and lets you take fast actions - all directly from Slack!

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-11-25.

Python AWS related posts

Index

What are some of the best open-source AWS projects in Python? This list will help you:

Project Stars
1 LocalStack 44,909
2 devops-exercises 33,863
3 data-science-ipython-notebooks 24,227
4 aws-cli 13,136
5 awesome-aws 10,941
6 chalice 9,320
7 serverless-application-model 8,814
8 boto3 7,714
9 aws-shell 6,656
10 ansible-for-devops 6,425
11 Moto 6,207
12 aws-sam-cli 6,139
13 dev-setup 5,840
14 SAWS 5,034
15 checkov 4,919
16 ScoutSuite 4,890
17 cloud-custodian 4,520
18 image-super-resolution 3,929
19 AWS Data Wrangler 3,225
20 gluonts 3,169
21 pacu 3,126
22 consoleme 2,898
23 streamalert 2,737
Truly a developer’s best friend
Scout APM is great for developers who want to find and fix performance issues in their applications. With Scout, we'll take care of the bugs so you can focus on building great things 🚀.
scoutapm.com