openmodelz
runbooks
openmodelz | runbooks | |
---|---|---|
2 | 4 | |
232 | 156 | |
2.6% | 3.8% | |
8.7 | 8.8 | |
6 months ago | 6 months ago | |
Go | Go | |
Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
openmodelz
runbooks
- Deploy and Fine-tune large language models on k8s - Trying this out this weekend
-
Show HN: Kubectl Notebook
Thanks for the feedback! All resources are namespaced right now, except there is an issue the notebook plugin where namespaces are indeed broken: https://github.com/substratusai/substratus/issues/193 Will get that fixed very soon.
- Deploy and fine-tune large language models on K8s
What are some alternatives?
covey - A lightweight Linux cluster orchestration system written in Go (Under active development, just working on plugins https://github.com/chabad360/plugins)
Awesome-LLM-Productization - Awesome-LLM-Productization: a curated list of tools/tricks/news/regulations about AI and Large Language Model (LLM) productization
vllm - A high-throughput and memory-efficient inference and serving engine for LLMs
flyte - Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
go-ml-benchmarks - ⏱ Benchmarks of machine learning inference for Go
kubernetes-operator-roiergasias - 'Roiergasias' kubernetes operator is meant to address a fundamental requirement of any data science / machine learning project running their pipelines on Kubernetes - which is to quickly provision a declarative data pipeline (on demand) for their various project needs using simple kubectl commands. Basically, implementing the concept of No Ops. The fundamental principle is to utilise best of docker, kubernetes and programming language features to run a workflow with minimal workflow definition syntax. It is a Go based workflow running on command line or Kubernetes with the help of a custom operator for a quick and automated data pipeline for your machine learning projects (a flavor of MLOps).
onepanel - The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.
envd - 🏕️ Reproducible development environment