Xpk Alternatives

Similar projects and alternatives to xpk

llama.cpp

773 56,891 10.0 C++ xpk VS llama.cpp

LLM inference in C/C++
ollama

198 62,615 9.9 Go xpk VS ollama

Get up and running with Llama 3, Mistral, Gemma, and other large language models.
InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
text-to-text-transfer-transformer

29 5,909 5.0 Python xpk VS text-to-text-transfer-transformer

Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"
gemma.cpp

8 5,516 9.3 C++ xpk VS gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.
ml-engineering

9 9,753 9.7 Python xpk VS ml-engineering

Machine Learning Engineering Open Book
gemma_pytorch

6 5,034 7.7 Python xpk VS gemma_pytorch

The official PyTorch implementation of Google's Gemma models
gemma

3 2,045 5.8 Jupyter Notebook xpk VS gemma

Open weights LLM from Google DeepMind.
SaaSHub

www.saashub.com featured

SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
ai-on-gke

2 144 9.8 Jupyter Notebook xpk VS ai-on-gke

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better xpk alternative or higher similarity.

Suggest an alternative to xpk

xpk reviews and mentions

Posts with mentions or reviews of xpk. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-02-21.

Gemma: New Open Models
12 projects | news.ycombinator.com | 21 Feb 2024

There is a lot of work to make the actual infrastructure and lower level management of lots and lots of GPUs/TPUs open as well - my team focuses on making the infrastructure bit at least a bit more approachable on GKE and Kubernetes.
https://github.com/GoogleCloudPlatform/ai-on-gke/tree/main
and
https://github.com/google/xpk (a bit more focused on HPC, but includes AI)
and
https://github.com/stas00/ml-engineering (not associated with GKE, but describes training with SLURM)
The actual training is still a bit of a small pool of very experienced people, but it's getting better. And every day serving models gets that much faster - you can often simply draft on Triton and TensorRT-LLM or vLLM and see significant wins month to month.