Pyinfra: Automate Infrastructure Using Python

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • koch

    Koch is a tool to install software packages, change files and other things on a single machine. The changes are described in a file and are written in Ruby.

  • https://github.com/marius/koch/blob/main/example/Rezeptfile suffers from the same problem I have with every single ruby ever: what are the available verbs I can type?

    Contrast that with https://docs.pyinfra.com/en/next/examples/client_side_assets... where any sane setup will show completions after both the `from` and the `local.` typing

  • pyinfra

    pyinfra turns Python code into shell commands and runs them on your servers. Execute ad-hoc commands and write declarative operations. Target SSH servers, local machine and Docker containers. Fast and scales from one server to thousands.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • aws-cdk

    The AWS Cloud Development Kit is a framework for defining cloud infrastructure in code

  • https://github.com/aws/aws-cdk#at-a-glance is the "generate cloudformation using code," and is the AWS version of troposphere as best I can tell

  • troposphere

    troposphere - Python library to create AWS CloudFormation descriptions

  • Seems like an interesting generalized mix of something like https://github.com/cloudtools/troposphere and Ansible from a glance.

    The value add would be unifying provisioning and configuration management in a Python-y experience? The lifecycle of each is distinct and that's traditionally where the headaches of using a single tool for both has come in

  • selfhost

    Selfhost your Forem Community on your own infrastructure 🎉

  • I just started using Pyinfra to wrangle a bunch of servers and it is a breath of fresh air compared to Ansible. I moved all of my server OS installs to Fedora CoreOS which doesn't ship with Python in the OS and since Pyinfra doesn't need Python on the host node I can kick off tasks in bulk to do server things. It is great. I cannot wait to see where the Pyinfra project goes.

    On a side note, one of the most hacky things I came up with to get Ansible working on Fedora CoreOS was to bind mount a container rootfs that had python 3 and then symlink it into the right spots. You can of course add Python in with rpm-ostree if you want but I wanted to avoid layering packages at the time. I wasn't proud of it. But it worked.

    https://github.com/forem/selfhost/blob/main/playbooks/templa...

  • dstack

    An open-source container orchestration engine for running AI workloads in any cloud or data center. https://discord.gg/u8SmfwPpMd

  • We build a similar tool except we focus on AI workloads. Also support on-prem clusters now in addition to GPU clouds. https://github.com/dstackai/dstack

  • salty

    Simple Saltstack-like deployment system in 1k lines of Python

  • Was there any thought to perhaps do a version with an agent? I really like how fast Saltstack can be as compared to Ansible.

    I've been using my own homegrown project that does just this - Python roles, server/client, Mako templates: https://github.com/mattbillenstein/salty

    It's very very fast to do deploys on long-lived infrastructure, but it hasn't been optimized for large clusters yet; I expect the server process will be a bottleneck with many clients, but still probably faster than Ansible for most setups.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Migrate 5 TB S3 bucket from one AWS account to another

    4 projects | /r/aws | 27 Jun 2023
  • Journey of creating a new AWS CloudFormation resource

    4 projects | dev.to | 9 Jun 2023
  • AWS Python SDK downloaded over 1.4B times a month

    1 project | news.ycombinator.com | 8 May 2024
  • Phidata: Add memory, knowledge and tools to LLMs

    1 project | news.ycombinator.com | 6 May 2024
  • This Week In Python

    5 projects | dev.to | 3 May 2024