dataset-viewer
aphrodite-engine
| dataset-viewer | aphrodite-engine | |
|---|---|---|
| 6 | 2 | |
| 622 | 596 | |
| 4.0% | 27.9% | |
| 9.8 | 9.7 | |
| 1 day ago | 5 days ago | |
| Python | Python | |
| Apache License 2.0 | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
dataset-viewer
aphrodite-engine
-
Using vLLM for Home Assistant. I need help getting any model to work. Can't get anything over 7B to run on a 3090.
Try out https://github.com/PygmalionAI/aphrodite-engine
-
Mistral 7B,The complete Guide of the Best 7B model
If you want to host for the AI Horde, Aphrodite has the most GPU throughput, and Koboldcpp is the easiest and quite flexible:
https://github.com/PygmalionAI/aphrodite-engine
What are some alternatives?
datasets - TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...
koboldcpp - A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
diffgram - The AI Datastore for Schemas, BLOBs, and Predictions. Use with your apps or integrate built-in Human Supervision, Data Workflow, and UI Catalog to get the most value out of your AI Data.
Savant - Python Computer Vision & Video Analytics Framework With Batteries Included
datasets - 🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
PhotoScavengerBackend - Backend for my Scangame react apps. It's a simple image recognition model that helps me understand API's, AI and native app development
squirrel-core - A Python library that enables ML teams to share, load, and transform data in a collaborative, flexible, and efficient way :chestnut:
astroid - A common base representation of python source code for pylint and other projects
tasksource - Datasets collection and preprocessings framework for NLP extreme multitask learning
petals - 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
FedML - FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.