shady.ai
coral-pi-rest-server
| shady.ai | coral-pi-rest-server | |
|---|---|---|
| 1 | 44 | |
| 107 | 66 | |
| - | - | |
| 7.6 | 0.0 | |
| 3 months ago | 7 months ago | |
| Dart | Jupyter Notebook | |
| GNU Affero General Public License v3.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
shady.ai
-
The Coming of Local LLMs
I’ve got some of their smaller Raven models running locally on my M1 (only 16GB of RAM).
I’m also in the middle of making it user friendly to run these models on all platforms (built with Flutter). First MacOS release will be out before this weekend: https://github.com/BrutalCoding/shady.ai
coral-pi-rest-server
- BeagleY-AI: 4 TOPS-capable $70 board from Beagleboard
- Do you recommend Orange PI for ML or LLM projects?
-
Framework for machine learning?
That said, you can always look at something like https://coral.ai/products/accelerator/ to help with the performance you need.
-
Mini PC for AI
Should only be ~$60 https://coral.ai/products/accelerator/
-
What are some USB devices worth using in a Home Lab Environment?
The Coral USB accelerator might be of interest if you want to do some light ML with a low power budget.
- Is a PCIe x1 enough for light ML tasks
-
Would I be able to run ggml models such as whisper.cpp or llama.cpp on a raspberry pi with a coral ai USB Accelerator?
However, a pi doesn't have the strength to run something like Llama.cpp, of course, so I've been considering using something like the Coral USB Accelerator (https://coral.ai/products/accelerator). As I've been learning more about it, it seems to be very geared towards TensorFlow Lite models. But whisper.cpp and Llama.cpp use ggml models.
- Looking for a Mini PC for Home Assistant and Frigate.
- AI development suite on a stick?
-
Modder wires ChatGPT into Skyrim VR so NPCs can roleplay and remember past conversations
Recently found this thing, though I haven't found a use case for me.
What are some alternatives?
StudentAI - StudentAI is an prompt-less AI chatbot app that uses OpenAI's large language model to help students learn more effectively. StudentAI can answer questions, provide explanations, and even generate creative content. This makes it a powerful tool for students of all ages and levels of learning.
alpaca.cpp - Locally run an Instruction-Tuned Chat-Style LLM
flutter_ci_cd - CI/CD & branching template for flutter apps
double-take - Unified UI and API for processing and training images for facial recognition.
more-ane-transformers - Run transformers (incl. LLMs) on the Apple Neural Engine.
rpi-urban-mobility-tracker - The easiest way to count pedestrians, cyclists, and vehicles on edge computing devices or live video feeds.
Flutter-AssetsAudioPlayer - Play simultaneously music/audio from assets/network/file directly from Flutter, compatible with android / ios / web / macos, displays notifications
opentts - Open Text to Speech Server
rwkv.cpp - INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
HASS-coral-rest-api - Coral REST API for HASS
os-nvr
ovos-core - OpenVoiceOS Core, the FOSS Artificial Intelligence platform.