AI-Horde-Worker VS KoboldAI-Client

Source: https://github.com/Haidra-Org/AI-Horde-Worker#ai-horde-worke...

This is a crowdsourced distributed cluster of Image generation workers and text generation workers. If you like this service, consider joining the horde yourself!

If you have your own mid-range GPU, you can onboard it onto the AI Horde. This will allow you to access the way more powerful GPUs provided by the other members of the horde and parallelize your workload a lot more efficiently or use way higher resolutions than before.

If you like doing this sort of packaging work and helping keep the barrier to entry low for tools democratizing AI, we could use the help with the AI Horde Worker.

Kobold AI-Horde-Worker

You can use KoboldAI to run a LLM locally. There are hundreds / thousands of models on hugging face. Some uncensored ones are Pygmalion AI (chatbot), Erebus (story writing AI), or Vicuna (general purpose).

GPT-J 6B is a pretty weak and outdated model. Nerys 13B would probably give you better replies but they lean more towards SFW stuff. Erebus was their best model for erotic roleplay but they removed it as it went against Google's TOS. You can check out their documentation here.

If you do have that kind of hardware, the next step would be looking for what model to run. I came across Kobold's models. Their main github page is here: https://github.com/KoboldAI/KoboldAI-Client

Then there are graphical user interfaces like text-generation-webui and gpt4all for general purpose chat. There are also KoboldAI and SillyTavern, they have focus more on storytelling and roleplay and have tools to improve that.

And finally the folks from the KoboldAi do some interesting stuff with Pseudocode and Soft-Prompts that might also be relevant.

Click this link. ---> https://github.com/KoboldAI/KoboldAI-Client/tree/main

Do you believe the problem could be that my KoboldAI is outdated? I did download the one from henk717 at https://github.com/KoboldAI/KoboldAI-Client but it was a little while ago.