Go llmops

Open-source Go projects categorized as llmops
Edit details
Topics: generative-ai AI Mlops Go Inference
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 6 Go llmops Projects

  • envd

    🏕️ Reproducible development environment

    • Project mention: Show HN: Dockerfile Alternative for AI/ML | news.ycombinator.com | 2023-08-15

  • agency

    🕵️‍♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach. (by neurocult)

    • Project mention: Agency: Pure Go LangChain Alternative | news.ycombinator.com | 2023-11-27

    I would, at the very least, wrap the errors being returned inside the process function https://github.com/neurocult/agency/blob/14b14e50a7570189388...

    Or, I suppose the user must handle exception behavior in their custom `OperationHandler`

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • openmodelz

    One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).

    • Project mention: Show HN: One-click machine learning deployment at scale on any cluster | news.ycombinator.com | 2024-01-10

  • runbooks

    Finetune LLMs on K8s by using Runbooks

    • Project mention: Deploy and Fine-tune large language models on k8s - Trying this out this weekend | /r/AIOps | 2023-09-21

  • gateway

    AI Gateway - core infrastructure stack for building production-ready AI Applications (by missingstudio)

    • Project mention: Show HN: I built an AI Gateway with gRPC support | news.ycombinator.com | 2024-03-28

  • glide

    🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps (by EinStack)

    • Project mention: Looking for cofounders to build open reliable LLM infra | news.ycombinator.com | 2024-04-29

    As a pivotal project, we are currently building Glide Gateway which ports an idea of API gateway into GenAI realities (https://github.com/EinStack/glide). We have a few more ideas in the pipeline but I guess we need more hands to get stuff done.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go llmops related posts

  • Show HN: I built an AI Gateway with gRPC support

    1 project | news.ycombinator.com | 28 Mar 2024

  • Show HN: One-click machine learning deployment at scale on any cluster

    1 project | news.ycombinator.com | 10 Jan 2024

  • Deploy and Fine-tune large language models on k8s - Trying this out this weekend

    1 project | /r/AIOps | 21 Sep 2023

  • Show HN: Kubectl Notebook

    1 project | news.ycombinator.com | 24 Aug 2023

  • Deploy and fine-tune large language models on K8s

    1 project | /r/hypeurls | 7 Aug 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 2 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source llmops projects in Go? This list will help you:

Project Stars
1 envd 1,919
2 agency 375
3 openmodelz 231
4 runbooks 156
5 gateway 138
6 glide 88

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com