go-ml-benchmarks
llama2.go
go-ml-benchmarks | llama2.go | |
---|---|---|
5 | 1 | |
30 | 183 | |
- | - | |
2.7 | 7.7 | |
10 days ago | 10 days ago | |
Go | Go | |
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
go-ml-benchmarks
-
Machine learning with GOlang
Tabular data is well supported in Go. Tabular data and small sample sizes is a sweet spot for Go. You may squeze in some meaningful performance and good looking code and integrations. Some entry points: (1) https://github.com/nikolaydubina/go-ml-benchmarks (2) https://github.com/dmitryikh/leaves (3) https://github.com/nikolaydubina/go-featureprocessing
- Show HN: Benchmarking Machine Learning Inference in Go
- Benchmarking machine learning inference latency in Go and Python
- [P] Benchmarking machine learning inference latency from Go to Python
- Benchmarking machine learning inference in Go
What are some alternatives?
leaves - pure Go implementation of prediction part for GBRT (Gradient Boosting Regression Trees) models from popular frameworks
aqueduct - Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure.
tflite-golang-gan-example
GoLLIE - Guideline following Large Language Model for Information Extraction
go-bench-stream - 🌊 Go Benchmarks for Stream Processing
llama.go - llama.go is like llama.cpp in pure Golang!
openmodelz - One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).
humanscript - A truly natural scripting language
ava - All-in-one desktop app for running LLMs locally.
llama-nuts-and-bolts - A holistic way of understanding how LLaMA and its components run in practice, with code and detailed documentation.