askai
KoboldAI-Client
Our great sponsors
askai | KoboldAI-Client | |
---|---|---|
2 | 185 | |
91 | 3,295 | |
- | - | |
10.0 | 6.3 | |
about 1 year ago | 16 days ago | |
Python | Python | |
MIT License | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
askai
-
Ask HN: How are you using GPT to be productive?
A while back, I wrote a simple CLI-wrapper around OpenAI's API that I'm using daily (https://github.com/maxvfischer/askai). I use it as an addition to Stackoverflow to ask quick programming-related question straight in the terminal.
KoboldAI-Client
- No idea what I'm doing help
-
ChatGPT users drop for the first time as people turn to uncensored chatbots
You can use KoboldAI to run a LLM locally. There are hundreds / thousands of models on hugging face. Some uncensored ones are Pygmalion AI (chatbot), Erebus (story writing AI), or Vicuna (general purpose).
-
Question regarding model compatibility for Alpaca Turbo
Then there are graphical user interfaces like text-generation-webui and gpt4all for general purpose chat. There are also KoboldAI and SillyTavern, they have focus more on storytelling and roleplay and have tools to improve that.
-
Running Multiple AI Models Sequentially for a Conversation on a Single GPU
And finally the folks from the KoboldAi do some interesting stuff with Pseudocode and Soft-Prompts that might also be relevant.
- Summoning Life-Size Characters to Your Room: New Update for my Mixed Reality App!
- Feels like the censorship has gotten tighter recently, just me?
-
Difficulties installing Pygmalion 13b
Do you believe the problem could be that my KoboldAI is outdated? I did download the one from henk717 at https://github.com/KoboldAI/KoboldAI-Client but it was a little while ago.
-
Training code and dataset for ProfitsBot_V0 experiments
I'm not to familiar with kobald, but it looks like you would have to write an inputModifier and outputModifier, https://github.com/KoboldAI/KoboldAI-Client/pull/4
-
ADOBE being ADOBE...
This is a crowdsourced distributed cluster of Image generation workers and text generation workers.
-
How to run pygmalion: usefull links
The main branch of kai (https://github.com/KoboldAI/KoboldAI-Client) doesn't yet have the support for 4 bit models. That's a problem for people who have under 16gb of VRAM. I use a branch with 4 bit support: https://github.com/0cc4m/KoboldAI. Instructions are available there but basically you'll need to get both the original model https://huggingface.co/PygmalionAI/pygmalion-6b and the 4 bit version https://huggingface.co/mayaeary/pygmalion-6b-4bit-128g. Throw 4 bit safetensors file into the full model and rename it to "4bit-128g.safetensors".
What are some alternatives?
TavernAI - Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
Open-Assistant - OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
KoboldAI
Clover-Edition - State of the art AI plays dungeon master to your adventures.
stable-diffusion-webui - Stable Diffusion web UI
llama - Inference code for Llama models
gpt-neo_dungeon - Colab notebooks to run a basic AI Dungeon clone using gpt-neo-2.7B
koboldcpp - A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
InvokeAI - InvokeAI is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, supports terminal use through a CLI, and serves as the foundation for multiple commercial products.
chatgpt-python - Unofficial Python SDK for OpenAI's ChatGPT
AIDCAT - AI Dungeon Catalog Archive Toolkit