-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
The main branch of kai (https://github.com/KoboldAI/KoboldAI-Client) doesn't yet have the support for 4 bit models. That's a problem for people who have under 16gb of VRAM. I use a branch with 4 bit support: https://github.com/0cc4m/KoboldAI. Instructions are available there but basically you'll need to get both the original model https://huggingface.co/PygmalionAI/pygmalion-6b and the 4 bit version https://huggingface.co/mayaeary/pygmalion-6b-4bit-128g. Throw 4 bit safetensors file into the full model and rename it to "4bit-128g.safetensors".
The main branch of kai (https://github.com/KoboldAI/KoboldAI-Client) doesn't yet have the support for 4 bit models. That's a problem for people who have under 16gb of VRAM. I use a branch with 4 bit support: https://github.com/0cc4m/KoboldAI. Instructions are available there but basically you'll need to get both the original model https://huggingface.co/PygmalionAI/pygmalion-6b and the 4 bit version https://huggingface.co/mayaeary/pygmalion-6b-4bit-128g. Throw 4 bit safetensors file into the full model and rename it to "4bit-128g.safetensors".
You can contribute your GPU time yourself and help out open source AI community. Install Kobold ai notmally get API key from https://stablehorde.net/, then set up this bridge: https://github.com/db0/KoboldAI-Horde-Bridge
Related posts
-
Llama V2 is free to try on the AI Horde
-
KoboldAI Lite now has Stable Horde integration for automatic inline image generation in stories.
-
Show HN: QuickVid 2 – Summarize and Fact-Check YouTube Videos in Seconds
-
Show HN: Summarize YouTube videos under 10 seconds
-
Wow! How to easily introduce GlobalState with AppRouter (RSC) and share the state across SC, CC, and ServerActions.