Python AWS

Open-source Python projects categorized as AWS

Top 23 Python AWS Projects

  • GitHub repo LocalStack

    💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline!

    Project mention: Building, Testing and Deploying AWS Lambda Functions in Ruby | dev.to | 2021-02-23

    There are options, such as localstack, for running AWS stacks locally.

  • GitHub repo data-science-ipython-notebooks

    Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

    Project mention: Resources for learning Python from scratch specifically for data ingestion | reddit.com/r/learnpython | 2021-02-13

    data science ipython notebooks

  • Scout

    Get performance insights in less than 4 minutes. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.

  • GitHub repo aws-cli

    Universal Command Line Interface for Amazon Web Services

    Project mention: APi Response Error: "Policies must be valid JSON and the first byte must be '{'" When Trying To Adjust CORS | reddit.com/r/aws | 2021-02-23

    When you say you are following that documentation, are you actually doing this using the CORS policy editor in the console? When I looked up this error I saw it in reference to the put-bucket-policy api: https://github.com/aws/aws-cli/issues/2779

  • GitHub repo awesome-aws

    A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

  • GitHub repo serverless-application-model

    AWS Serverless Application Model (SAM) is an open-source framework for building serverless applications

    Project mention: Building Static Ruby Gems for Lambda Zip or Containers using Docker & Amazon Linux | dev.to | 2021-02-21

    Welcome to my 3rd post in a long running series on Lambda & Containers. If you are a Rubyist new to Lambda and the Serverless Application Model (SAM), consider looking over this Ruby Microservice Workshop.

  • GitHub repo chalice

    Python Serverless Microframework for AWS

    Project mention: news.ycombinator.com | 2021-02-10

    AWS Lambdas are an easy way to get scheduled scraping jobs running.

    I use their Python-based chalice framework (https://github.com/aws/chalice) which allows you to add a decorator to a method for a schedule,

      @app.schedule(Rate(30, unit=Rate.MINUTES))

  • GitHub repo devops-exercises

    Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions

    Project mention: Questions you would get asked on an interview? | reddit.com/r/devops | 2021-01-28

    I think the link you're looking for is https://github.com/bregman-arie/devops-exercises

  • GitHub repo boto3

    AWS SDK for Python

    Project mention: Dear boto3 dynamodb users, I have in a feature request that I think would really benefit everyone. If you agree, please chime in on my thread, because I think it's going to just get lost in the noise otherwise. | reddit.com/r/aws | 2021-02-04
  • GitHub repo aws-sam-cli

    CLI tool to build, test, debug, and deploy Serverless applications using AWS SAM

    Project mention: Building Static Ruby Gems for Lambda Zip or Containers using Docker & Amazon Linux | dev.to | 2021-02-21

    Since this project is for Lambda, we used the base image provided by AWS SAM CLI.

  • GitHub repo dev-setup

    macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

    Project mention: Request Im A Programmer That Moves To A New Pc | reddit.com/r/TechnologyProTips | 2020-12-31
  • GitHub repo SAWS

    A supercharged AWS command line interface (CLI).

  • GitHub repo Moto

    A library that allows you to easily mock out tests based on AWS infrastructure.

    Project mention: AWS, Boto3, Python, and Microsoft Visual Studio Code | reddit.com/r/aws | 2021-02-14

    Check out moto. It's great for writing unit tests for boto3 stuff. There isn't coverage for all services or API calls but the core services are pretty solid.

  • GitHub repo ScoutSuite

    Multi-Cloud Security Auditing Tool

    Project mention: ScoutSuite: A Security Audit Tool for Azure | dev.to | 2021-02-16

    $ git clone https://github.com/nccgroup/ScoutSuite $ cd ScoutSuite $ virtualenv -p python3 venv $ source venv/bin/activate $ pip install -r requirements.txt $ python scout.py --help

  • GitHub repo bless

    Repository for BLESS, an SSH Certificate Authority that runs as a AWS Lambda function

    Project mention: Why SSH certificates are awesome | dev.to | 2020-11-03

    3. BLESS - By Netflix

  • GitHub repo checkov

    Prevent cloud misconfigurations during build-time for Terraform, Cloudformation, Kubernetes, Serverless framework and other infrastructure-as-code-languages with Checkov by Bridgecrew.

    Project mention: Best static code analysis tool for Terraform? | reddit.com/r/devops | 2021-02-03
  • GitHub repo PynamoDB

    A pythonic interface to Amazon's DynamoDB

  • GitHub repo AWS Data Wrangler

    Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

    Project mention: Best way to install pandas and bumpy to AWS Lanbda | reddit.com/r/aws | 2021-01-18
  • GitHub repo cfn-python-lint

    CloudFormation Linter

    Project mention: DevOps tools you should have on your belt | dev.to | 2021-01-22

    ✔️ AWS CloudFormation Linter is a tool that validates AWS CloudFormation YAML/JSON templates against the AWS CloudFormation Resource Specification.

  • GitHub repo policy_sentry

    IAM Least Privilege Policy Generator

    Project mention: Show HN: Endgame – An AWS Pentesting tool to backdoor or expose AWS resources | news.ycombinator.com | 2021-02-16

    @kmcquade ur awesome ! we are users of https://github.com/salesforce/policy_sentry and definitely definitely https://github.com/salesforce/cloudsplaining .

    If I could give you guys money, I would. You should totally build a startup around it.

  • GitHub repo python-lambda

    A toolkit for developing and deploying serverless Python code in AWS Lambda.

  • GitHub repo sceptre

    Build better AWS infrastructure

    Project mention: What is the best tool for managing CloudFormation stacks with CLI? | reddit.com/r/aws | 2021-02-10

    On the tool side you have sceptre: https://github.com/Sceptre/sceptre

  • GitHub repo ethereum-etl

    Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

    Project mention: Trying To Recover Old ETH | reddit.com/r/ethereum | 2021-01-01

    You can use https://github.com/blockchain-etl/ethereum-etl

  • GitHub repo nixops

    NixOps is a tool for deploying to NixOS machines in a network or cloud.

    Project mention: Benefits/disadvantages of Guix System in general and over NixOS? | reddit.com/r/GUIX | 2021-02-10

    I'll have to read more about NixOps though, I had kind of forgotten that it existed!

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2021-02-23.

Index

What are some of the best open-source AWS projects in Python? This list will help you:

Project Stars
1 LocalStack 28,752
2 data-science-ipython-notebooks 20,249
3 aws-cli 10,695
4 awesome-aws 8,923
5 serverless-application-model 7,729
6 chalice 7,644
7 devops-exercises 7,591
8 boto3 6,157
9 aws-sam-cli 5,421
10 dev-setup 5,313
11 SAWS 4,699
12 Moto 4,376
13 ScoutSuite 2,771
14 bless 2,524
15 checkov 2,043
16 PynamoDB 1,498
17 AWS Data Wrangler 1,491
18 cfn-python-lint 1,449
19 policy_sentry 1,256
20 python-lambda 1,237
21 sceptre 1,147
22 ethereum-etl 919
23 nixops 830