inference-benchmark
agentchain
inference-benchmark | agentchain | |
---|---|---|
1 | 2 | |
26 | 563 | |
- | 0.2% | |
6.4 | 5.8 | |
11 months ago | about 1 year ago | |
Python | Python | |
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
inference-benchmark
-
[D] Handling Concurrent Request for ML Model API
I have done some benchmarks before: https://github.com/tensorchord/inference-benchmark
agentchain
What are some alternatives?
ChatFred - Alfred workflow using ChatGPT, DALL·E 2 and other models for chatting, image generation and more.
inference - Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
mosec - A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
aihandler - A simple engine to help run diffusers and transformers models
text-generation-inference - Large Language Model Text Generation Inference
InternChat - InternGPT / InternChat allows you to interact with ChatGPT by clicking, dragging and drawing using a pointing device. [Moved to: https://github.com/OpenGVLab/InternGPT]
InternGPT - InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)
truss - The simplest way to serve AI/ML models in production
swarms - Orchestrate Swarms of Agents From Any Framework Like OpenAI, Langchain, and Etc for Business Operation Automation. Join our Community: https://discord.gg/DbjBMJTSWD