Go llm

Open-source Go projects categorized as llm
Topics: Golang AI openai Go llama

Top 23 Go llm Projects

  • Milvus

    A cloud-native vector database, storage for next generation AI applications

  • Project mention: AIM Weekly 17 June 2024 | dev.to | 2024-06-17
  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • plandex

    AI driven development in your terminal. Designed for large, real-world tasks.

  • Project mention: Plandex 1.1.0 – AI driven development in the terminal. Now multi-modal. | news.ycombinator.com | 2024-06-11
  • LLocalSearch

    LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.

  • Project mention: Show HN: I made a better Perplexity for developers | news.ycombinator.com | 2024-05-08

    Ah nice, good work :) I might steal some design ideas for my own project haha https://github.com/nilsherzig/LLocalSearch

  • flyte

    Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

  • Project mention: First 15 Open Source Advent projects | dev.to | 2023-12-15

    9. Flyte by Union AI | Github | tutorial

  • casibase

    Spising: ⚡️Open-source AI LangChain-like RAG (Retrieval-Augmented Generation) knowledge database with web UI and Enterprise SSO⚡️, supports OpenAI, Azure, LLaMA, Google Gemini, HuggingFace, Claude, Grok, etc., chat bot demo: https://demo.casibase.com, admin UI demo: https://demo-admin.casibase.com

  • Project mention: Open-source AI knowledge database with web UI and Enterprise SSO | news.ycombinator.com | 2023-12-21
  • zep

    Zep: Long-Term Memory for ‍AI Assistants.

  • Project mention: Show HN: Ellipsis – Automated PR reviews and bug fixes | news.ycombinator.com | 2024-05-09

    Hmm, that searches issues, which isn't the best way to see Ellipsis' work.

    Example of PR review: https://github.com/getzep/zep-js/pull/67#discussion_r1594781...

    Example of issue-to-PR: https://github.com/getzep/zep/issues/316

    Example of bug fix on a PR: https://github.com/jxnl/instructor/pull/546#discussion_r1544...

  • training-operator

    Distributed ML Training and Fine-Tuning on Kubernetes

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • llama.go

    llama.go is like llama.cpp in pure Golang!

  • tlm

    Local CLI Copilot, powered by CodeLLaMa. 💻🦙 (by yusufcanb)

  • Project mention: What AI assistants are already bundled for Linux? | news.ycombinator.com | 2024-03-01

    Perhaps this: https://github.com/yusufcanb/tlm?

    it is not distro bundled (yet), but I have it running on my Fedora Linux 39 running on a NUC with 16GB of RAM. Performance is good enough for me.

  • BricksLLM

    🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

  • Project mention: We built a highly scalable LLM gateway with go | news.ycombinator.com | 2024-04-01
  • lingoose

    🪿 LinGoose is a Go framework for building awesome AI/LLM applications.

  • Project mention: A Go framework for building AI/LLM applications | news.ycombinator.com | 2024-05-22
  • aqueduct

    Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure. (by RunLLM)

  • hof

    Framework that joins data models, schemas, code generation, and a task engine. Language and technology agnostic.

  • Project mention: Hof v0.6.9 – more CUE powered tools and extensions | news.ycombinator.com | 2024-06-07

    Hi HN, this is a project I've created initially for code gen from Yaml DSLs, but after hacking imports into Yaml... I went soul searching and discovered CUE. Since then I've become a big fan of the language and have been experimenting with various ways to use CUE, many of which have landed in hof


  • HuggingFaceModelDownloader

    Simple go utility to download HuggingFace Models and Datasets

  • Project mention: HuggingFace Is Down | news.ycombinator.com | 2024-02-28

    Model downloaders of the world unite!

    Here’s my PR ;,) https://github.com/bodaay/HuggingFaceModelDownloader/pull/25

  • agency

    🕵️‍♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach. (by neurocult)

  • Project mention: Agency: Pure Go LangChain Alternative | news.ycombinator.com | 2023-11-27

    I would, at the very least, wrap the errors being returned inside the process function https://github.com/neurocult/agency/blob/14b14e50a7570189388...

    Or, I suppose the user must handle exception behavior in their custom `OperationHandler`

  • paddler

    Stateful load balancer custom-tailored for llama.cpp

  • Project mention: Show HN: Open-Source Load Balancer for Llama.cpp | news.ycombinator.com | 2024-06-01

    Looks like it’s to only have one completion running at a time currently, https://github.com/distantmagic/paddler/blob/main/loadbalanc... I was curious if there was any other cache tracking happening

  • galah

    Galah: An LLM-powered web honeypot. Wasting attackers' time with faker-than-ever HTTP responses!

  • Project mention: Galah: An LLM-powered web honeypot using the OpenAI API | news.ycombinator.com | 2024-02-02
  • helix

    Multi-node production AI stack. Run the best of open source AI easily on your own servers. Create your own AI by fine-tuning open source models. Integrate LLMs with APIs. Run gptscript securely on the server (by helixml)

  • Project mention: RAG, fine-tuning, API calling and gptscript for Llama 3 running locally | news.ycombinator.com | 2024-05-24
  • beta9

    The open-source serverless GPU container runtime.

  • Project mention: Show HN: Beta9 – Open-source, serverless GPU container runtime | news.ycombinator.com | 2024-05-13
  • aikit

    🏗️ Fine-tune, build, and deploy open-source LLMs easily!

  • Project mention: AIKit: Build and deploy LLMs easily with only Docker | news.ycombinator.com | 2023-12-12
  • evalgpt

    EvalGPT is an code interpreter framework that utilizes large language models to automate the process of code-writing and execution, delivering precise results for user-defined tasks. (by index-labs)

  • Project mention: Show HN: EvalGPT – Code interpreter and agent framework inspired by Google Borg | news.ycombinator.com | 2023-09-05
  • savvy-cli

    Create, share, and run runbooks from your terminal.

  • Project mention: AI copilot tools for your terminal | dev.to | 2024-06-12

    So far Savvy has been very easy to use on the terminal. I’m also using it to create and share runbooks, like the ones below

  • llama2.go

    LLaMA-2 in native Go

  • Project mention: LLAMA2.go | /r/golang | 2023-07-29
  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go llm discussion

Log in or Post with

Go llm related posts


What are some of the best open-source llm projects in Go? This list will help you:

Project Stars
1 Milvus 27,747
2 plandex 9,710
3 LLocalSearch 5,319
4 flyte 5,119
5 casibase 2,377
6 zep 2,069
7 training-operator 1,500
8 llama.go 1,186
9 tlm 1,105
10 BricksLLM 785
11 lingoose 528
12 aqueduct 522
13 hof 489
14 HuggingFaceModelDownloader 394
15 agency 395
16 paddler 368
17 galah 327
18 helix 273
19 beta9 287
20 aikit 259
21 evalgpt 246
22 savvy-cli 195
23 llama2.go 185

Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.