Python Infrastructure

Open-source Python projects categorized as Infrastructure

Top 23 Python Infrastructure Projects

Infrastructure
  1. Prefect

    The easiest way to build, run, and monitor data pipelines at scale.

    Project mention: Show HN: Flow – A Dynamic Task Engine for AI Agents Without DAG | news.ycombinator.com | 2024-12-02

    - https://github.com/PrefectHQ/prefect

  2. Stream

    Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.

    Stream logo
  3. SaltStack

    Software to automate the management and configuration of infrastructure and applications at scale.

    Project mention: Linux from the user's perspective - Part1: Installing Linux | dev.to | 2025-06-17

    Of course, booting from a disk is not the only option. If you want to automate installs across servers - you have to boot from the network. That is something you could play around with, in GNS3 for example, using FAI or your own system based on SaltStack. You could skip the installation altogether, and use a Live Image, or a Thin Client.

  4. Sacred

    Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

  5. pyinfra

    🔧 pyinfra turns Python code into shell commands and runs them on your servers. Execute ad-hoc commands and write declarative operations. Target SSH servers, local machine and Docker containers. Fast and scales from one server to thousands.

    Project mention: Shef | news.ycombinator.com | 2025-03-10
  6. catalyst

    Accelerated deep learning R&D (by catalyst-team)

  7. mitogen

    Distributed self-replicating programs in Python

  8. Udacity-Data-Engineering-Projects

    Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

  9. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  10. sceptre

    Build better AWS infrastructure

  11. cli

    a lightweight, security focused, BDD test framework against terraform. (by terraform-compliance)

  12. runhouse

    Distribute and run AI workloads magically in Python, like PyTorch for ML infra.

    Project mention: Show HN: RAG app example with self-hosted embedding and LLM services | news.ycombinator.com | 2024-08-13
  13. opta

    The next generation of Infrastructure-as-Code. Work with high-level constructs instead of getting lost in low-level cloud configuration.

  14. suzieq

    Using network observability to operate and design healthier networks

  15. carefree-drawboard

    ðŸŽĻ Infinite Drawboard in Python

  16. proxmoxer

    python wrapper for Proxmox API v2 (https://pve.proxmox.com/pve-docs/api-viewer/index.html)

  17. infra

    Infrastructure to set up the public Compiler Explorer instances and compilers (by compiler-explorer)

  18. nebari

    ðŸŠī Nebari - your open source data science platform (by nebari-dev)

  19. infraform

    Creating infrastructure and running applications using different platforms

  20. knee

    An interactive open-source CLI tool built on top of Ansible, used to automate infrastructure setup.

  21. ol-infrastructure

    Infrastructure automation code for use by MIT Open Learning

  22. alto

    Serverless for data practitioners. The fastest ⚡ïļ way to run your code in the cloud. Effortlessly run scripts, functions, and Jupyter notebooks in virtual machines. (by runprism)

  23. anki-meetup-memorizer

    Generates Anki flashcard decks with names and faces of Meetup attendees.

  24. sphinx-diagrams

    Rough Sphinx extension for diagrams

  25. infracheck

    Incredibly elastic and lightweight health check endpoint to cover ANY CASE, including infrastructure as well as applications

  26. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Infrastructure discussion

Log in or Post with

Python Infrastructure related posts

  • DevOps, MLOps, or Platform Engineering, In 2025, who will own the pipeline?

    4 projects | dev.to | 20 Jun 2025
  • Two File Descriptors for Sockets

    1 project | news.ycombinator.com | 22 Jan 2024
  • Sacred VS cascade - a user suggested alternative

    2 projects | 5 Dec 2023
  • Launch HN: Onu (YC W23) – Turn scripts into internal tools in minutes

    4 projects | news.ycombinator.com | 31 May 2023
  • GitHub - cdev-framework/cdev-sdk: Cdev Python SDK - Cdev provides a development environment and framework that allows python developers to easily create and deploy Serverless Applications on Amazon Web Services.

    1 project | /r/Python | 26 Feb 2023
  • Mitogen is a Python library for writing distributed self-replicating programs

    1 project | news.ycombinator.com | 6 Feb 2023
  • FLiP Stack Weekly for 21 Jan 2023

    19 projects | dev.to | 23 Jan 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 14 Jul 2025
    InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now. Learn more →

Index

What are some of the best open-source Infrastructure projects in Python? This list will help you:

# Project Stars
1 Prefect 19,767
2 SaltStack 14,597
3 Sacred 4,316
4 pyinfra 4,313
5 catalyst 3,354
6 mitogen 2,403
7 Udacity-Data-Engineering-Projects 1,618
8 sceptre 1,516
9 cli 1,398
10 runhouse 1,040
11 opta 914
12 suzieq 825
13 carefree-drawboard 703
14 proxmoxer 642
15 infra 381
16 nebari 299
17 infraform 56
18 knee 50
19 ol-infrastructure 48
20 alto 39
21 anki-meetup-memorizer 23
22 sphinx-diagrams 20
23 infracheck 20

Sponsored
Stream - Scalable APIs for Chat, Feeds, Moderation, & Video.
Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.
getstream.io

Did you know that Python is
the 2nd most popular programming language
based on number of references?