KoboldAI-Client VS InvokeAI

You can use KoboldAI to run a LLM locally. There are hundreds / thousands of models on hugging face. Some uncensored ones are Pygmalion AI (chatbot), Erebus (story writing AI), or Vicuna (general purpose).

GPT-J 6B is a pretty weak and outdated model. Nerys 13B would probably give you better replies but they lean more towards SFW stuff. Erebus was their best model for erotic roleplay but they removed it as it went against Google's TOS. You can check out their documentation here.

If you do have that kind of hardware, the next step would be looking for what model to run. I came across Kobold's models. Their main github page is here: https://github.com/KoboldAI/KoboldAI-Client

Then there are graphical user interfaces like text-generation-webui and gpt4all for general purpose chat. There are also KoboldAI and SillyTavern, they have focus more on storytelling and roleplay and have tools to improve that.

And finally the folks from the KoboldAi do some interesting stuff with Pseudocode and Soft-Prompts that might also be relevant.

Click this link. ---> https://github.com/KoboldAI/KoboldAI-Client/tree/main

Do you believe the problem could be that my KoboldAI is outdated? I did download the one from henk717 at https://github.com/KoboldAI/KoboldAI-Client but it was a little while ago.

Probably not, since I have no idea what you're talking about. I've just been using the models that InvokeAI (2.3, I only just now saw there's a 3.0) downloads for me [0]. The SD1.5 one is as good as ever, but the SD2 model introduces artifacts on (many, but not all) faces and copyrighted characters.

[0] https://github.com/invoke-ai/InvokeAI

I actually used the rocm/pytorch image you also linked.

I'm not sure what you're pointing to with your reference to the Fedora-based images. I'm quite happy with my NixOS install and really don't want to switch to anything else. And as long as I have the correct kernel module, my host OS really shouldn't matter to run any of the images.

And I'm sure it can be made to work with many base images, my point was just that the dependency management around pytorch was in a bad state, where it is extremely easy to break.

> Anyways, hopefully this PR fixes the immediate issue: https://github.com/invoke-ai/InvokeAI/pull/5714/files

It does! At least for me. It is my PR after all ;)

The data being flagged is not in that github repo, it's fetched from elsewhere and I don't fancy spending time looking for it. The alert is for 'Sirefef!cfg' which has been reported as a false positive with a bunch of other stable diffusion projects (https://www.reddit.com/r/StableDiffusion/comments/101zjec/trojanwin32sirefefcfg_an_apparently_common_false/, https://www.reddit.com/r/StableDiffusion/comments/xmhukb/trojan_in_waifudiffusion_model_file/, https://github.com/invoke-ai/InvokeAI/issues/2773 )

I haven’t tried it recently, but InvokeAI runs on Mac. Invoke. I used to run on my MacBook, but have since gotten a Win laptop.

There are already a number of local, inference options that are (crucially) open-source, with more robust feature sets.

And if the defense here is "but Auto1111 and Comfy don't have as user-friendly a UI", that's also already covered. https://github.com/invoke-ai/InvokeAI

https://github.com/invoke-ai/InvokeAI should work on your machine. For LLM models, the smaller ones should run using llama.cpp, but I don't think you'll be happy comparing them to ChatGPT.

Stable Diffusion. /r/stablediffusion There are many tutorials on how to set it up locally and use it. InvokeAI is the easiest way to set it up. https://github.com/invoke-ai/InvokeAI

InvokeAI