Inference-benchmark Alternatives

Similar projects and alternatives to inference-benchmark based on common topics and language

• text-generation-inference

  29 7,881 9.6 Python inference-benchmark VS text-generation-inference

  Large Language Model Text Generation Inference

  

• mosec

  11 707 8.5 Python inference-benchmark VS mosec

  A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• agentchain

  2 563 5.8 Python inference-benchmark VS agentchain

  Chain together LLMs for reasoning & orchestrate multiple large models for accomplishing complex tasks

  

• ChatFred

  4 376 6.3 Python inference-benchmark VS ChatFred

  Alfred workflow using ChatGPT, DALL·E 2 and other models for chatting, image generation and more.

• inference

  2 2,629 9.8 Python inference-benchmark VS inference

  Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

  

• truss

  3 833 9.6 Python inference-benchmark VS truss

  The simplest way to serve AI/ML models in production (by basetenlabs)