vidur

A large-scale simulation framework for LLM inference (by microsoft)
Add to my DEV experience Inference llm Simulation Transformer vllm
Source Code
Suggest alternative
Edit details
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Vidur Alternatives

Similar projects and alternatives to vidur based on common topics and language

microsoft
vidur

  • vllm

    32 vidur VS vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo

  • GoLLIE

    1 vidur VS GoLLIE

    Guideline following Large Language Model for Information Extraction

  • AtomGPT

    1 vidur VS AtomGPT

    Discontinued 中英文预训练大模型，目标与ChatGPT的水平一致

  • JetStream

    1 vidur VS JetStream

    JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome). (by google)

  • vllm-rocm

    1 vidur VS vllm-rocm

    vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

  • llm-vscode-inference-server

    1 vidur VS llm-vscode-inference-server

    An endpoint server for efficiently serving quantized open-source LLMs for code.

  • faster-whisper

    24 vidur VS faster-whisper

    Faster Whisper transcription with CTranslate2

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better vidur alternative or higher similarity.
Suggest an alternative to vidur

vidur discussion

Log in or Post with

vidur reviews and mentions

Posts with mentions or reviews of vidur. We have used some of these posts to build our list of alternatives and similar projects.

Stats

Basic vidur repo stats
1
105
6.2
about 1 month ago

microsoft/vidur is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of vidur is Python.


Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com