Python Cloud

Open-source Python projects categorized as Cloud

Top 23 Python Cloud Projects

  • LocalStack

    💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline

    Project mention: LocalStack e AWS CLI: Como desenvolver localmente com a AWS | dev.to | 2024-01-28

    Acesse o site da LocalStack e faça login.

  • aws-cli

    Universal Command Line Interface for Amazon Web Services

    Project mention: Top 10 CLI Tools for DevOps Teams | dev.to | 2023-08-14

    The AWS CLI is a must-have tool if your team relies on Amazon Web Services. It lets you effortlessly interact with AWS services, orchestrate resource management, and automate tasks from the comfort of your terminal. Once you get used to the tool, you'll notice how convenient and quick it is to fit into your processes – especially compared to going through AWS's web-based user interface.

  • WorkOS

    The modern API for authentication & user identity. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • SaltStack

    Software to automate the management and configuration of any infrastructure or application at scale. Get access to the Salt software package repository here:

    Project mention: Looking for a way to remote in to K's of raspberry pi's... | /r/sysadmin | 2023-12-10
  • awesome-aws

    A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

  • chalice

    Python Serverless Microframework for AWS

    Project mention: Jets: The Ruby Serverless Framework | news.ycombinator.com | 2023-12-07

    That looks similar to Chalice (also for Python)

    https://github.com/aws/chalice

  • prowler

    Prowler is an Open Source Security tool for AWS, Azure, GCP and Kubernetes to do security assessments, audits, incident response, compliance, continuous monitoring, hardening and forensics readiness. Includes CIS, NIST 800, NIST CSF, CISA, FedRAMP, PCI-DSS, GDPR, HIPAA, FFIEC, SOC2, GXP, Well-Architected Security, ENS and more

    Project mention: Ask HN: Cloud security auditing for indie-grade projects? | news.ycombinator.com | 2023-12-04

    Which cloud provider?

    https://github.com/prowler-cloud/prowler is easy to get going with, and gives decent results. It's much stronger at AWS than GCP or Azure.

    Steampipe can be a little harder to wrap your head around, but scales really well and has broader support: https://hub.steampipe.io/mods?objectives=security

  • boto3

    AWS SDK for Python

    Project mention: AWS Boto3: Clients vs Resources - DynamoDB | dev.to | 2024-01-21

    Recently, my colleague brought up the difficulty of using the AWS SDK for Python (Boto3) while working with DynamoDB, especially the cumbersome mapping of AttributeValue objects on the Table operations. One of the easiest ways to get around this difficulty is to switch from the clients interface to the resources interface.

  • LearnThisRepo.com

    Learn 300+ open source libraries for free using AI. LearnThisRepo lets you learn 300+ open source repos including Postgres, Langchain, VS Code, and more by chatting with them using AI!

  • aws-shell

    An integrated shell for working with the AWS CLI.

    Project mention: 9 Ways to an EKS Cluster - Way 2 - AWS CLI | dev.to | 2024-02-25

    While at it - I heartily recommend you to install aws-shell which boosts your aws cli productivity by providing graphical autocompletion, hints and shortcuts as shown in the image below. I only discovered it recently myself and it's definitely a game changer!

  • server

    The Triton Inference Server provides an optimized cloud and edge inferencing solution. (by triton-inference-server)

    Project mention: FLaNK Weekly 08 Jan 2024 | dev.to | 2024-01-08
  • docker-android

    Android in docker solution with noVNC supported and video recording

  • dev-setup

    macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

  • ScoutSuite

    Multi-Cloud Security Auditing Tool

    Project mention: Azure and M365 Secure Config Review | /r/Pentesting | 2023-05-31

    Prowler and ScoutSuite are a good start for cloud stuff.

  • SAWS

    A supercharged AWS command line interface (CLI).

  • cloud-custodian

    Rules engine for cloud security, cost optimization, and governance, DSL in yaml for policies to query, filter, and take actions on resources

    Project mention: Cutting down AWS cost by $150k per year simply by shutting things off | news.ycombinator.com | 2024-01-22

    > The best optimization is simply shutting things off

    This is the way.

    A similar idea has been bouncing around in my mind for a while now. An ideal, turnkey system would do the following:

    - Execute via Lambda (serverless).

    - Support automated startup and shutdown of various AWS resources on a schedule influenced by specially formatted tags.

    - Enable resources to be brought back up out of schedule when demand dictates.

    - Operate as a TCP/HTTP proxy that can delay clients so that a given service can be started when it is dormant or, even better, the service isn't serverless but you want it to be. This can't work for everything, but perhaps enough things such that the need to run always on services is reduced.

    Cloud Custodian [1] can purportedly do some of this, but I've been reluctant to learn yet another YAML-based DSL to use it.

    So this is my "make things designed to be always-on serverless instead" project and the work AWS has done to make Java apps function on Lambda keeps me thinking about the potential to take things that 1) have a relatively long startup time and 2) are designed to be long running service loops, and find a way to force them into the serverless execution model.

    [1] https://cloudcustodian.io/

  • azure-cli

    Azure Command-Line Interface

    Project mention: Azure CLI takes ~700MB of disk space | news.ycombinator.com | 2023-11-30
  • leptonai

    A Pythonic framework to simplify AI service building

    Project mention: Show HN: Running LLMs in one line of Python without Docker | news.ycombinator.com | 2023-10-04

    Hello Hacker News! We're Yangqing, Xiang and JJ from lepton.ai. We are building a platform to run any AI models as easy as writing local code, and to get your favorite models in minutes. It's like container for AI, but without the hassle of actually building a docker image.

    We built and contributed to some of the world's most popular AI software - PyTorch 1.0, ONNX, Caffe, etcd, Kubernetes, etc. We also managed hundreds of thousands of computers in our previous jobs. And we found that the AI software stack is usually unnecessarily complex - and we want to change that.

    Imagine if you are a developer who sees a good model on github, or HuggingFace. To make it a production ready service, the current solution usually requires you to build a docker image. But think about it - I have a few python code and a few python dependencies. That sounds like a huge overhead, right?

    lepton.ai is really a pythonic way to free you from such difficulties. You write a simple python scaffold around your PyTorch / TensorFlow code, and lepton launches it as a full-fledged service callable via python, javascript, or any language that understands OpenAPI. We use containers under the hood, but you don't need to worry about all the infrastructure nuts and bolts.

    We have made the python library open-source at https://github.com/leptonai/leptonai/. With it, launching a common HuggingFace model is as simple as a one liner. For example, if you have a GPU, Stable Diffusion XL is as simple as:

    ```

  • apache-libcloud

    Apache Libcloud is a Python library which hides differences between different cloud provider APIs and allows you to manage different cloud resources through a unified and easy to use API.

  • policy_sentry

    IAM Least Privilege Policy Generator

  • mist-ce

    Mist is an open source, multicloud management platform

  • nixops

    NixOps is a tool for deploying to NixOS machines in a network or cloud.

    Project mention: 20 Years of Nix | news.ycombinator.com | 2023-03-18

    As far as I know, it’s still about [0]. I’ve had a better experience with deploy-rs though [1] - or even just using nixos-rebuild to target the remote machine.

    [0] - https://github.com/NixOS/nixops

  • sceptre

    Build better AWS infrastructure

  • cloudproxy

    Hide your scrapers IP behind the cloud. Provision proxy servers across different cloud providers to improve your scraping success.

  • nagios-plugins

    450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-02-25.

Python Cloud related posts

Index

What are some of the best open-source Cloud projects in Python? This list will help you:

Project Stars
1 LocalStack 51,466
2 aws-cli 14,693
3 SaltStack 13,741
4 awesome-aws 12,005
5 chalice 10,216
6 prowler 9,225
7 boto3 8,600
8 aws-shell 7,092
9 server 6,922
10 docker-android 6,820
11 dev-setup 6,032
12 ScoutSuite 6,031
13 SAWS 5,177
14 cloud-custodian 5,148
15 azure-cli 3,813
16 leptonai 2,216
17 apache-libcloud 1,995
18 policy_sentry 1,925
19 mist-ce 1,823
20 nixops 1,632
21 sceptre 1,447
22 cloudproxy 1,329
23 nagios-plugins 1,114
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com