aphrodite-engine
Savant
aphrodite-engine | Savant | |
---|---|---|
2 | 54 | |
596 | 483 | |
27.9% | 3.5% | |
9.7 | 9.3 | |
5 days ago | 4 days ago | |
Python | Python | |
GNU Affero General Public License v3.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
aphrodite-engine
-
Using vLLM for Home Assistant. I need help getting any model to work. Can't get anything over 7B to run on a 3090.
Try out https://github.com/PygmalionAI/aphrodite-engine
-
Mistral 7B,The complete Guide of the Best 7B model
If you want to host for the AI Horde, Aphrodite has the most GPU throughput, and Koboldcpp is the easiest and quite flexible:
https://github.com/PygmalionAI/aphrodite-engine
Savant
-
🚀 Savant 0.2.6 is Out: Release Notes
Website: https://savant-ai.io/
-
Meet a new Savant Demo: Realtime (45 FPS) YOLOv8 instance segmentation
Link: https://github.com/insight-platform/Savant/tree/develop/samples/yolov8_seg
- Opt for a new innovative deep learning and computer vision framework on Nvidia platforms.
- Experience the benefits of a new Nvidia-optimized open-source framework in computer vision projects.
What are some alternatives?
koboldcpp - A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
pipeless - An open-source computer vision framework to build and deploy apps in minutes without worrying about multimedia pipelines [Moved to: https://github.com/pipeless-ai/pipeless]
dataset-viewer - Lightweight web API for visualizing and exploring any dataset - computer vision, speech, text, and tabular - stored on the Hugging Face Hub
rpi-object-detection - Real-time object detection and tracking using Raspberry Pi and OpenCV!
PhotoScavengerBackend - Backend for my Scangame react apps. It's a simple image recognition model that helps me understand API's, AI and native app development
caer - High-performance Vision library in Python. Scale your research, not boilerplate.