Go Inference

Open-source Go projects categorized as Inference
Edit details
Topics: AI llm Machine Learning Mlops llama
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 6 Go Inference Projects

  • onepanel

    The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.

  • openmodelz

    One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).

    • Project mention: Show HN: One-click machine learning deployment at scale on any cluster | news.ycombinator.com | 2024-01-10

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • llama2.go

    LLaMA-2 in native Go

    • Project mention: LLAMA2.go | /r/golang | 2023-07-29

  • aikit

    🏗️ Fine-tune, build, and deploy open-source LLMs easily!

    • Project mention: AIKit: Build and deploy LLMs easily with only Docker | news.ycombinator.com | 2023-12-12

  • gateway

    AI Gateway - core infrastructure stack for building production-ready AI Applications (by missingstudio)

    • Project mention: Show HN: I built an AI Gateway with gRPC support | news.ycombinator.com | 2024-03-28

  • go-ml-benchmarks

    ⏱ Benchmarks of machine learning inference for Go

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go Inference related posts

  • Show HN: I built an AI Gateway with gRPC support

    1 project | news.ycombinator.com | 28 Mar 2024

  • Show HN: One-click machine learning deployment at scale on any cluster

    1 project | news.ycombinator.com | 10 Jan 2024

Index

What are some of the best open-source Inference projects in Go? This list will help you:

Project Stars
1 onepanel 696
2 openmodelz 231
3 llama2.go 182
4 aikit 177
5 gateway 138
6 go-ml-benchmarks 30

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com