runpod-llm

Runpod-LLM provides ready-to-use container scripts for running large language models (LLMs) easily on RunPod. (by zeeb0tt)
Review llama-cpp llama-cpp-python llamacpp llamacpp-python LLM llm-inference llm-serving llm-training llmops llms ollama ollama-api runpod runpod-endpoint runpod-serverless runpod-worker runpods
Source Code
Suggest alternative
Edit details
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Runpod-llm Alternatives

Similar projects and alternatives to runpod-llm

zeeb0tt
runpod-llm

  1. comfyui

    1 runpod-llm VS comfyui

    ComfyUI docker images for use in GPU cloud and local environments. Includes AI-Dock base for authentication and improved user experience. (by ai-dock)

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  3. LLMOne

    1 runpod-llm VS LLMOne

    Enterprise-grade LLM automated deployment tool that makes AI servers truly "plug-and-play".

  4. lorax

    4 runpod-llm VS lorax

    Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

  5. ollama-proxy

    2 runpod-llm VS ollama-proxy

    Nginx proxy server in a Docker container to Authenticate & Proxy requests to Ollama from Public Internet via Cloudflare Tunnel

  6. shellm

    1 runpod-llm VS shellm

    A one-file Ollama CLI client written in bash (by Biont)

  7. my_config_files

    1 runpod-llm VS my_config_files

    Discontinued Tiny Bash utilities that turn your terminal into an AI‑powered dev hub. [GET https://api.github.com/repos/ayuxsec/my_config_files: 404 - Not Found // See: https://docs.github.com/rest/repos/repos#get-a-repository] (by ayuxsec)

  8. OpenLLM

    29 runpod-llm VS OpenLLM

    Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

  9. callama

    1 runpod-llm VS callama

    Discontinued ☎️🦙 call llama.cpp directly, either locally or remotely.

  10. BentoML

    18 runpod-llm VS BentoML

    The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

  11. aici

    9 runpod-llm VS aici

    AICI: Prompts as (Wasm) Programs

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better runpod-llm alternative or higher similarity.
Suggest an alternative to runpod-llm

runpod-llm discussion

Log in or Post with

runpod-llm reviews and mentions

Posts with mentions or reviews of runpod-llm. We have used some of these posts to build our list of alternatives and similar projects.

Stats

Basic runpod-llm repo stats
1
5
6.7
about 1 year ago

zeeb0tt/runpod-llm is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of runpod-llm is Shell.

Popular Comparisons

  1. runpod-llm VS comfyui
  2. runpod-llm VS LLMOne
  3. runpod-llm VS lorax
  4. runpod-llm VS ollama-proxy
  5. runpod-llm VS shellm
  6. runpod-llm VS my_config_files
  7. runpod-llm VS OpenLLM
  8. runpod-llm VS callama
  9. runpod-llm VS BentoML
  10. runpod-llm VS aici

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com

Did you know that Shell is
the 8th most popular programming language
based on number of references?

Loading...