fastbpe
llama.go
fastbpe | llama.go | |
---|---|---|
1 | 12 | |
2 | 1,178 | |
- | - | |
5.5 | 8.2 | |
about 1 year ago | 6 months ago | |
Java | Go | |
MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fastbpe
-
Understanding GPT Tokenizers
Tokenization is very important and I did implement fastbpe in java to understand things - https://github.com/deepanprabhu/fastbpe
llama.go
-
Understanding GPT Tokenizers
You might reuse simple LLaMA tokenizer right in your Go code, look there:
https://github.com/gotzmann/llama.go/blob/8cc54ca81e6bfbce25...
-
April 2023
llama.go is like llama.cpp in pure Golang (https://github.com/gotzmann/llama.go)
- llama.go v1.4 - introduces Rest API for your GPT services
- [Golang] Llama.go - Meta's Llama GPT Inférence dans Pure Golang
- LLaMA.go v1.4: now with scalable REST API exposing local GPT model
- Local LLaMA REST API with llama.go v1.4
- LLaMA.go v1.4 - introducing REST API for building your own GPT services
-
MiniGPT-4
I'm developing framework [1] in Golang with this goal in mind :) It successfully runs relatively big LLM right now, and diffusion models will be the next step
[1] https://github.com/gotzmann/llama.go/
- gotzmann/llama.go: llama.go is like llama.cpp in pure Golang!
- Show HN: Llama.go – port of llama.cpp to pure Go
What are some alternatives?
Constrained-Text-Genera
Flowise - Drag & drop UI to build your customized LLM flow
llama-tokenizer-js - JS tokenizer for LLaMA 1 and 2
gpt4all.unity - Bindings of gpt4all language models for Unity3d running on your local machine
Constrained-Text-Generation-Studio - Code repo for "Most Language Models can be Poets too: An AI Writing Assistant and Constrained Text Generation Studio" at the (CAI2) workshop, jointly held at (COLING 2022)
nn-zero-to-hero - Neural Networks: Zero to Hero
agency - Agency: Robust LLM Agent Management with Go
tokenizer - Pure Go implementation of OpenAI's tiktoken tokenizer
LLamaStack - ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharp
langchain-alpaca - Run Alpaca LLM in LangChain
prompt-engineering - ChatGPT Prompt Engineering for Developers - deeplearning.ai
shortgpt - Ask shortgpt for instant and concise answers