Vllm-rocm Alternatives

Similar projects and alternatives to vllm-rocm based on common topics and language

• vllm

  30 18,571 9.9 Python vllm-rocm VS vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  

• local-llm-function-calling

  1 258 7.0 Python vllm-rocm VS local-llm-function-calling

  A tool for generating function arguments and choosing what function to call with local LLMs

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• pinferencia

  21 556 0.0 Python vllm-rocm VS pinferencia

  Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

  

• text-generation-inference

  29 7,881 9.6 Python vllm-rocm VS text-generation-inference

  Large Language Model Text Generation Inference

  

• AtomGPT

  1 189 10.0 Python vllm-rocm VS AtomGPT

  Discontinued 中英文预训练大模型，目标与ChatGPT的水平一致

  

• mosec

  11 703 8.5 Python vllm-rocm VS mosec

  A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine