Top 23 Python Infrastructure Projects

• Prefect

  19 14,645 10.0 Python

  The easiest way to build, run, and monitor data pipelines at scale.

  

Project mention: Prefect: A workflow orchestration tool for data pipelines | news.ycombinator.com | 2024-03-13

• Sacred

  6 4,158 3.5 Python

  Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

  

Project mention: Sacred VS cascade - a user suggested alternative | libhunt.com/r/sacred | 2023-12-05

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• catalyst

  1 3,227 0.0 Python

  Accelerated deep learning R&D (by catalyst-team)

  

Project mention: Instance segmentation of small objects in grainy drone imagery | /r/computervision | 2023-12-09

• pyinfra

  31 2,644 9.0 Python

  pyinfra automates infrastructure using Python. It’s fast and scales from one server to thousands. Great for ad-hoc command execution, service deployment, configuration management and more.

  

Project mention: This Week In Python | dev.to | 2024-05-03

pyinfra – automates infrastructure using Python

• mitogen

  11 2,259 8.2 Python

  Distributed self-replicating programs in Python

  

Project mention: Two File Descriptors for Sockets | news.ycombinator.com | 2024-01-22

Ran into a variant of this when working on an IO loop, ended up with a little "Side" abstraction to wrap bidirectional/unidirectional descriptors to behave identically for the rest of the library. It's an annoying wart but pretty easy to avoid in userspace.. https://github.com/mitogen-hq/mitogen/blob/798032b9/mitogen/...

• sceptre

  6 1,452 8.6 Python

  Build better AWS infrastructure

  

• cli

  7 1,324 5.3 Python

  a lightweight, security focused, BDD test framework against terraform. (by terraform-compliance)

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• Udacity-Data-Engineering-Projects

  5 1,295 0.0 Python

  Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Project mention: Pitanje za data engineering? | /r/programiranje | 2023-06-30

• opta

  18 907 0.0 Python

  The next generation of Infrastructure-as-Code. Work with high-level constructs instead of getting lost in low-level cloud configuration.

  

• suzieq

  2 747 7.1 Python

  Using network observability to operate and design healthier networks

  

• runhouse

  6 711 9.8 Python

  Fast, Pythonic AI services and workflows on your own infra. Unobtrusive, debuggable, PyTorch-like APIs.

  

Project mention: Runhouse | news.ycombinator.com | 2024-04-22

• proxmoxer

  1 462 4.6 Python

  python wrapper for Proxmox API v2 (https://pve.proxmox.com/pve-docs/api-viewer/index.html)

  

• infra

  1 317 9.7 Python

  Infrastructure to set up the public Compiler Explorer instances and compilers (by compiler-explorer)

  

• nebari

  1 257 9.5 Python

  🪴 Nebari - your open source data science platform (by nebari-dev)

  

• infraform

  1 57 0.0 Python

  Creating infrastructure and running applications using different platforms

• ol-infrastructure

  2 42 9.9 Python

  Infrastructure automation code for use by MIT Open Learning

  

Project mention: We are the Pulumi Engineering team - Ask us about our new products and features | /r/pulumi | 2023-06-21

Here is another good repo with a lot of production pulumi code: https://github.com/mitodl/ol-infrastructure

• alto

  1 35 9.5 Python

  Serverless for data practitioners. The fastest ⚡️ way to run your code in the cloud. Effortlessly run scripts, functions, and Jupyter notebooks in virtual machines. (by runprism)

  

Project mention: Show HN: I created a CLI tool to run a Docker image in an EC2 instance | news.ycombinator.com | 2024-01-14

• anki-meetup-memorizer

  1 22 10.0 Python

  Generates Anki flashcard decks with names and faces of Meetup attendees.

  

• infracheck

  1 18 2.4 Python

  Incredibly elastic and lightweight health check endpoint to cover ANY CASE, including infrastructure as well as applications

  

• sphinx-diagrams

  1 18 1.8 Python

  Rough Sphinx extension for diagrams

• knee

  1 16 9.5 Python

  An interactive open-source CLI tool built on top of Ansible, used to automate infrastructure setup.

  

Project mention: Show HN: Knee, OSS CLI tool to reduce time for infra orchestration | news.ycombinator.com | 2024-04-23

• multicloud-diagrams

  1 16 9.3 Python

  PyPI package to draw AWS infrastructure diagrams in popular drawio vector editable format

Project mention: Hi guys! Feedback needed! Check my project that renders AWS Cloud infrastructure in drawio format. sources github: https://github.com/tsypuk/multicloud-diagrams and also documentation that is compiled from tests with real snippets and renders nodes: https://blog.tsypuk.com/multicloud-diagrams/ | /r/coolgithubprojects | 2023-09-06

• cdev-sdk

  3 9 3.3 Python

  Cdev Python SDK

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Python Infrastructure related posts

• Two File Descriptors for Sockets

  1 project | news.ycombinator.com | 22 Jan 2024

• Sacred VS cascade - a user suggested alternative

  2 projects | 5 Dec 2023

• Launch HN: Onu (YC W23) – Turn scripts into internal tools in minutes

  4 projects | news.ycombinator.com | 31 May 2023

• GitHub - cdev-framework/cdev-sdk: Cdev Python SDK - Cdev provides a development environment and framework that allows python developers to easily create and deploy Serverless Applications on Amazon Web Services.

  1 project | /r/Python | 26 Feb 2023

• Mitogen is a Python library for writing distributed self-replicating programs

  1 project | news.ycombinator.com | 6 Feb 2023

• FLiP Stack Weekly for 21 Jan 2023

  19 projects | dev.to | 23 Jan 2023

• Can I use {subreddit}.json?

  2 projects | /r/redditdev | 14 Nov 2022
• A note from our sponsor - SaaSHub
  www.saashub.com | 4 May 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!