Shell llm-serving Projects
-
runpod-llm
Runpod-LLM provides ready-to-use container scripts for running large language models (LLMs) easily on RunPod.
Project mention: Runpod-LLM provides ready-to-use container scripts for running LLMs on RunPod | news.ycombinator.com | 2025-05-19 -
Stream
Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Shell llm-serving discussion
Index
| # | Project | Stars |
|---|---|---|
| 1 | runpod-llm | 3 |
Sponsored
Stream - Scalable APIs for Chat, Feeds, Moderation, & Video.
Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.
getstream.io