SaaSHub helps you find the best software and product alternatives Learn more →
Top 12 Python Cloud Computing Projects
-
skypilot
SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.
-
cloud-custodian
Rules engine for cloud security, cost optimization, and governance, DSL in yaml for policies to query, filter, and take actions on resources
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
OpenStack Tracking Repo
Repository tracking all OpenStack repositories as submodules. Mirror of code maintained at opendev.org.
-
-
AppScale
AppScale is an easy-to-manage serverless platform for building and running scalable web and mobile applications on any infrastructure. (by AppScale)
-
-
lithops
A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
squirrel-core
A Python library that enables ML teams to share, load, and transform data in a collaborative, flexible, and efficient way :chestnut:
-
-
notes-aws-sysops
Contains my notes and projects used in reviewing for the AWS SysOps Administrator exam (SOA-C01).
Project mention: Ask HN: Most efficient way to fine-tune an LLM in 2024? | news.ycombinator.com | 2024-04-04
Project mention: Cutting down AWS cost by $150k per year simply by shutting things off | news.ycombinator.com | 2024-01-22> The best optimization is simply shutting things off
This is the way.
A similar idea has been bouncing around in my mind for a while now. An ideal, turnkey system would do the following:
- Execute via Lambda (serverless).
- Support automated startup and shutdown of various AWS resources on a schedule influenced by specially formatted tags.
- Enable resources to be brought back up out of schedule when demand dictates.
- Operate as a TCP/HTTP proxy that can delay clients so that a given service can be started when it is dormant or, even better, the service isn't serverless but you want it to be. This can't work for everything, but perhaps enough things such that the need to run always on services is reduced.
Cloud Custodian [1] can purportedly do some of this, but I've been reluctant to learn yet another YAML-based DSL to use it.
So this is my "make things designed to be always-on serverless instead" project and the work AWS has done to make Java apps function on Lambda keeps me thinking about the potential to take things that 1) have a relatively long startup time and 2) are designed to be long running service loops, and find a way to force them into the serverless execution model.
[1] https://cloudcustodian.io/
Project mention: Cobbler: Allows for rapid setup of network installation environments | news.ycombinator.com | 2024-02-26
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python Cloud Computing related posts
-
Ask HN: Most efficient way to fine-tune an LLM in 2024?
-
Cobbler: Allows for rapid setup of network installation environments
-
SGLang: Fast and Expressive LLM Inference with RadixAttention for 5x Throughput
-
Serving Your Private Code Llama-70B with API, Chat, and VSCode Access
-
A new old kind of R&D lab
-
When have you screwed up, bad?
-
Open-Source tools for monitoring ML/AI usage- Recommendations?
-
A note from our sponsor - SaaSHub
www.saashub.com | 4 May 2024
Index
What are some of the best open-source Cloud Computing projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | skypilot | 5,675 |
| 2 | cloud-custodian | 5,219 |
| 3 | OpenStack Tracking Repo | 5,189 |
| 4 | Cobbler | 2,541 |
| 5 | AppScale | 2,426 |
| 6 | skyplane | 973 |
| 7 | lithops | 306 |
| 8 | squirrel-core | 279 |
| 9 | squirrel-datasets-core | 43 |
| 10 | notes-aws-sysops | 22 |
| 11 | Cracow Cloud One | 14 |
| 12 | NetDevOps | 1 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com