Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
Why do you think that https://github.com/xorbitsai/inference is a good alternative to inference-benchmark
Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
Why do you think that https://github.com/xorbitsai/inference is a good alternative to inference-benchmark