Aphrodite-engine Alternatives
Similar projects and alternatives to aphrodite-engine
-
petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
dataset-viewer
Lightweight web API for visualizing and exploring any dataset - computer vision, speech, text, and tabular - stored on the Hugging Face Hub
-
PhotoScavengerBackend
Backend for my Scangame react apps. It's a simple image recognition model that helps me understand API's, AI and native app development
-
astroid
A common base representation of python source code for pylint and other projects (by pylint-dev)
-
FedML
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, FEDML Nexus AI (https://fedml.ai) is your generative AI platform at scale.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
aphrodite-engine reviews and mentions
-
Using vLLM for Home Assistant. I need help getting any model to work. Can't get anything over 7B to run on a 3090.
Try out https://github.com/PygmalionAI/aphrodite-engine
-
Mistral 7B,The complete Guide of the Best 7B model
If you want to host for the AI Horde, Aphrodite has the most GPU throughput, and Koboldcpp is the easiest and quite flexible:
https://github.com/PygmalionAI/aphrodite-engine
Stats
PygmalionAI/aphrodite-engine is an open source project licensed under GNU Affero General Public License v3.0 which is an OSI approved license.
The primary programming language of aphrodite-engine is Python.
Popular Comparisons
Sponsored