aphrodite-engine
dataset-viewer
aphrodite-engine | dataset-viewer | |
---|---|---|
2 | 6 | |
596 | 622 | |
27.9% | 4.0% | |
9.7 | 9.8 | |
8 days ago | 5 days ago | |
Python | Python | |
GNU Affero General Public License v3.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
aphrodite-engine
-
Using vLLM for Home Assistant. I need help getting any model to work. Can't get anything over 7B to run on a 3090.
Try out https://github.com/PygmalionAI/aphrodite-engine
-
Mistral 7B,The complete Guide of the Best 7B model
If you want to host for the AI Horde, Aphrodite has the most GPU throughput, and Koboldcpp is the easiest and quite flexible:
https://github.com/PygmalionAI/aphrodite-engine
dataset-viewer
What are some alternatives?
koboldcpp - A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
datasets - TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...
Savant - Python Computer Vision & Video Analytics Framework With Batteries Included
diffgram - The AI Datastore for Schemas, BLOBs, and Predictions. Use with your apps or integrate built-in Human Supervision, Data Workflow, and UI Catalog to get the most value out of your AI Data.
PhotoScavengerBackend - Backend for my Scangame react apps. It's a simple image recognition model that helps me understand API's, AI and native app development
datasets - 🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
astroid - A common base representation of python source code for pylint and other projects
squirrel-core - A Python library that enables ML teams to share, load, and transform data in a collaborative, flexible, and efficient way :chestnut:
petals - 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
tasksource - Datasets collection and preprocessings framework for NLP extreme multitask learning
FedML - FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.