Infrastructure

Open-source projects categorized as Infrastructure
Edit details
Language: + Go + Python + Rust + JavaScript + Ruby + TypeScript + PHP + HTML + C + Java
Topics: AWS DevOps Kubernetes Terraform Python
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Sponsored

Top 23 Infrastructure Open-Source Projects

  • backstage

    Backstage is an open platform for building developer portals

    • Project mention: # Enable Developers on SAP BTP with Terraform, GitHub Actions and Backstage | dev.to | 2024-03-18

    apiVersion: scaffolder.backstage.io/v1beta3 # https://backstage.io/docs/features/software-catalog/descriptor-format#kind-template kind: Template metadata: name: sample-btpsubaccount-remote-template title: Remote Template for SAP BTP Subaccount Setup description: A remote template that creates a basic SAP BTP Subaccount setup tags: - sap - btp - basic - javascript spec: owner: user:guest type: service

  • sonic

    🦔 Fast, lightweight & schema-less search backend. An alternative to Elasticsearch that runs on a few MBs of RAM.

    • Project mention: What is Hybrid Search? | dev.to | 2024-02-06

    Sonic - a project written in Rust, uses custom network communication protocol for fast communication between the client and the server.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • Prefect

    The easiest way to build, run, and monitor data pipelines at scale.

    • Project mention: Prefect: A workflow orchestration tool for data pipelines | news.ycombinator.com | 2024-03-13

  • xg2xg

    by ex-googlers, for ex-googlers - a lookup table of similar tech & services

    • Project mention: An ex-Googler's guide to dev tools | news.ycombinator.com | 2023-11-28

    What about Mendel and Streamz? I don't see those in https://github.com/jhuangtw/xg2xg

  • howtheysre

    A curated collection of publicly available resources on how technology and tech-savvy organizations around the world practice Site Reliability Engineering (SRE)

    • Project mention: 5 GitHub Projects to Help You Become a Better DevOps Engineer ⚡ | dev.to | 2023-06-23

    1. How they SRE

  • crossplane

    The Cloud Native Control Plane

    • Project mention: Rethinking Infrastructure as Code from Scratch | news.ycombinator.com | 2023-07-21

    did anyone adopt in production https://crossplane.io ?

  • cortex

    Production infrastructure for machine learning at scale

    • Project mention: Ask HN: Are there any reliable benchmarks for Machine Learning Model Serving? | news.ycombinator.com | 2024-02-10

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • Chef

    Chef Infra, a powerful automation platform that transforms infrastructure into code automating how infrastructure is configured, deployed and managed across any environment, at any scale

  • php-pm

    PPM is a process manager, supercharger and load balancer for modern PHP applications.

  • jsdelivr

    A free, fast, and reliable Open Source CDN for npm, GitHub, Javascript, and ESM

    • Project mention: Cloudflare is slow and Cloudflare cant do much about it | news.ycombinator.com | 2023-05-11

    Russia has blocked Cloudflare too too. You can see it in the issues for jsDelivr (which apparently handles a lot of traffic for TASS, since they use the CDN and browsers don't share caches for privacy reasons). https://github.com/jsdelivr/jsdelivr/issues/762

  • terrascan

    Detect compliance and security violations across Infrastructure as Code to mitigate risk before provisioning cloud native infrastructure.

    • Project mention: A Deep Dive Into Terraform Static Code Analysis Tools: Features and Comparisons | dev.to | 2024-04-16

    Terrascan Owner/Maintainer: Tenable (acquired in 2022) Age: First release on GitHub on November 28th, 2017 License: Apache License 2.0

  • Sacred

    Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

    • Project mention: Sacred VS cascade - a user suggested alternative | libhunt.com/r/sacred | 2023-12-05

  • Red-Team-Infrastructure-Wiki

    Wiki to collect Red Team infrastructure hardening resources

  • kubernetes-goat

    Kubernetes Goat is a "Vulnerable by Design" cluster environment to learn and practice Kubernetes security using an interactive hands-on playground 🚀

  • keepalived

    Keepalived

  • warpgate

    Smart SSH, HTTPS and MySQL bastion that requires no additional client-side software

    • Project mention: SSH With SSO | /r/selfhosted | 2023-07-02

    It's rather for access control with like, 50+ clients. Possibly with access control. I'm currently testing with warpgate

  • arroyo

    Distributed stream processing engine in Rust

    • Project mention: FLaNK AI Weekly 18 March 2024 | dev.to | 2024-03-18

  • catalyst

    Accelerated deep learning R&D (by catalyst-team)

    • Project mention: Instance segmentation of small objects in grainy drone imagery | /r/computervision | 2023-12-09

  • doctl

    The official command line interface for the DigitalOcean API.

  • esm.sh

    A fast, smart, & global CDN for modern(es2015+) web development.

    • Project mention: Building a self-creating website with Supabase and AI | dev.to | 2024-04-23

    /* eslint-disable @typescript-eslint/ban-ts-comment */ // Follow this setup guide to integrate the Deno language server with your editor: // https://deno.land/manual/getting_started/setup_your_environment // This enables autocomplete, go to definition, etc. import { corsHeaders } from "../_shared/cors.ts"; import { createClient } from "https://esm.sh/@supabase/[email protected]"; import randomSample from "https://esm.sh/@stdlib/[email protected]"; import Replicate from "https://esm.sh/[email protected]"; import { base64 } from "https://cdn.jsdelivr.net/gh/hexagon/base64@1/src/base64.js"; const supabaseClient = createClient( Deno.env.get("SUPABASE_URL") ?? "", Deno.env.get("SUPABASE_SERVICE_ROLE_KEY") ?? "" ); const replicate = new Replicate({ auth: Deno.env.get("REPLICATE_API_TOKEN") ?? "", }); // @ts-expect-error Deno.serve(async (req) => { if (req.method === "OPTIONS") { return new Response("ok", { headers: corsHeaders }); } const { record } = await req.json(); const thought_id = record.id; if (!thought_id) { return new Response("Missing thought_id", { status: 400, headers: { "Content-Type": "application/json", ...corsHeaders }, }); } const allObjectIDsResponse = await fetch( "https://collectionapi.metmuseum.org/public/collection/v1/objects?departmentIds=11", { method: "GET", headers: { "Content-Type": "application/json", Accept: "application/json", }, } ); const { objectIDs } = await allObjectIDsResponse.json(); const listOfArtworks = []; const addedIDs: number[] = []; while (listOfArtworks.length < 80) { const randomObjectID = randomSample(objectIDs, { size: 1 })[0]; if (addedIDs.includes(randomObjectID)) continue; const res = await fetch( `https://collectionapi.metmuseum.org/public/collection/v1/objects/${randomObjectID}`, { method: "GET", headers: { "Content-Type": "application/json", Accept: "application/json", }, } ); const artwork = await res.json(); if (!artwork.primaryImageSmall) continue; addedIDs.push(artwork.objectID); listOfArtworks.push({ image_url: artwork.primaryImageSmall, artist_name: artwork.artistDisplayName, title: artwork.title, is_main: listOfArtworks.length === 0, is_variant: false, thought_id, }); } const mainImage = listOfArtworks[0]; const output = await replicate.run( "yorickvp/llava-13b:b5f6212d032508382d61ff00469ddda3e32fd8a0e75dc39d8a4191bb742157fb", { input: { image: mainImage.image_url, top_p: 1, prompt: "Describe this painting by " + mainImage.artist_name, max_tokens: 1024, temperature: 0.2, }, } ); const file = await fetch(mainImage.image_url).then((res) => res.blob()); const promises = []; for (let i = 0; i < 8; i++) { const body = new FormData(); body.append( "prompt", output.join("") + `, a painting by ${mainImage.artist_name}` ); body.append("output_format", "jpeg"); body.append("mode", "image-to-image"); body.append("image", file); body.append("strength", clamp(Math.random(), 0.4, 0.7)); const request = fetch( `${Deno.env.get( "STABLE_DIFFUSION_HOST" )}/v2beta/stable-image/generate/sd3`, { method: "POST", headers: { Accept: "application/json", Authorization: `Bearer ${Deno.env.get("STABLE_DIFFUSION_API_KEY")}`, }, body, } ); promises.push(request); } const results = await Promise.all(promises); const variants = await Promise.all(results.map((res) => res.json())); await supabaseClient.from("artworks").insert(listOfArtworks); for (let i = 0; i < variants.length; i++) { const variant = variants[i]; const randomId = Math.random(); await supabaseClient.storage .from("variants") .upload( `${thought_id}/${randomId}.jpeg`, base64.toArrayBuffer(variant.image), { contentType: "image/jpeg", } ); await supabaseClient.from("artworks").insert({ image_url: `${Deno.env.get( "SUPABASE_URL" )}/storage/v1/object/public/variants/${thought_id}/${randomId}.jpeg`, artist_name: mainImage.artist_name, is_main: false, is_variant: true, thought_id, }); } await supabaseClient .from("thoughts") .update({ generating: false }) .eq("id", thought_id); return new Response(JSON.stringify({ main: mainImage }), { headers: { "Content-Type": "application/json", ...corsHeaders }, }); }); function clamp(value: number, min: number, max: number) { return Math.min(Math.max(value, min), max); }

  • aws-cf-templates

    Free Templates for AWS CloudFormation

  • pyinfra

    pyinfra automates infrastructure using Python. It’s fast and scales from one server to thousands. Great for ad-hoc command execution, service deployment, configuration management and more.

    • Project mention: Show HN: A new open-source automation tool as an alternative to Ansible/Salt | news.ycombinator.com | 2024-04-17

    There is https://pyinfra.com/

    As a sidenote, I also made a small experiment a while ago : https://github.com/linkdd/tricorder/

    But it's a bit of a chicken-and-egg problem. Without users, I don't know how it should be used, without features I won't get any users. So for now, it's in a state of "I'll address bug reports and feature requests, but I won't actively develop it".

  • foreman

    an application that automates the lifecycle of servers (by theforeman)

    • Project mention: Overmind, a better foreman or bin/dev for your Procfile | news.ycombinator.com | 2023-07-29

    I was confused because there is https://github.com/ddollar/foreman and https://github.com/theforeman/foreman

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Infrastructure related posts

Index

What are some of the best open-source Infrastructure projects? This list will help you:

Project Stars
1 backstage 26,317
2 sonic 19,419
3 Prefect 14,586
4 xg2xg 14,068
5 howtheysre 8,918
6 crossplane 8,728
7 cortex 7,990
8 Chef 7,475
9 php-pm 6,539
10 jsdelivr 5,374
11 terrascan 4,494
12 Sacred 4,155
13 Red-Team-Infrastructure-Wiki 3,884
14 kubernetes-goat 3,862
15 keepalived 3,787
16 warpgate 3,333
17 arroyo 3,275
18 catalyst 3,223
19 doctl 3,193
20 esm.sh 2,808
21 aws-cf-templates 2,729
22 pyinfra 2,638
23 foreman 2,495

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com