Containerized AI before Apocalypse 🐳🤖

This page summarizes the projects mentioned and recommended in the original post on dev.to

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • ggml

    Tensor library for machine learning

  • Thanks to the efforts of the amazing community projects like ggml, llama.cpp, and TheBloke, it is now possible for anyone to converse with AI before the apocalypse.

  • llama.cpp

    LLM inference in C/C++

  • Thanks to the efforts of the amazing community projects like ggml, llama.cpp, and TheBloke, it is now possible for anyone to converse with AI before the apocalypse.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • ialacol

    Discontinued 🪶 Lightweight OpenAI drop-in replacement for Kubernetes

  • We are deploying a Helm release orca-mini-3b using Helm chart ialacol

  • open_llama

    OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

  • The deployed LLM binary, orca mini, has 3 billion parameters. Orca mini is based on the OpenLLaMA project.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts