anaconda-issues VS KoboldAI-Client

Google search of the issue also turned up this thread: https://github.com/ContinuumIO/anaconda-issues/issues/72

I found this post on github that describes the same issue I'm facing but the solutions didn't help.

A scientist typically wouldn't write web backend, a sysadmin doesn't do a lot of statistical stuff, etc.

A small startup might do well to make their MVP in Python, but as the code grows the implicit costs (of using Python) do too.

- - - -

In re: Rust, sorry I wasn't clear above. I don't mean that Rust is a glue language, I mean that people write e.g. grep replacements in it and things like that. Python does systems programming by being glue, Rust does it by being, well, Rust. It makes sense to me that Rust libs would get Python wrappers, but it also seems to me that that adds to my argument: Python is good for small glue, but crunchy things (like grep) should be written in e.g. Rust or Go or something.

- - - -

One other things about Python is that the packaging & distribution "story" is ridiculous now. The people in charge of that call themselves the Python Packaging Authority (which name, given what they're doing, reminds me of Brazil the movie) and they seem to me to be running amok, cargo-culting the crap out of what should be a pretty simple and straightforward problem. I could go on but I feel a rant brewing, so I'll cut it off there.

It's not just the PyPA folks that are having problems packaging and distributing Python. The Conda folks ship Tkinter in a broken state for five years now: https://github.com/ContinuumIO/anaconda-issues/issues/6833 That's the default GUI system that ships with the Python Standard Library.

Compare and contrast with Rust's Cargo, or Nim's Nimble, or Erlang's Rebar, etc.

If so, you can check this solution. I've encountered this same issue when using Anaconda or Conda. https://github.com/ContinuumIO/anaconda-issues/issues/6833

https://github.com/ContinuumIO/anaconda-issues/issues/1206#issuecomment-258672013

You can use KoboldAI to run a LLM locally. There are hundreds / thousands of models on hugging face. Some uncensored ones are Pygmalion AI (chatbot), Erebus (story writing AI), or Vicuna (general purpose).

GPT-J 6B is a pretty weak and outdated model. Nerys 13B would probably give you better replies but they lean more towards SFW stuff. Erebus was their best model for erotic roleplay but they removed it as it went against Google's TOS. You can check out their documentation here.

If you do have that kind of hardware, the next step would be looking for what model to run. I came across Kobold's models. Their main github page is here: https://github.com/KoboldAI/KoboldAI-Client

Then there are graphical user interfaces like text-generation-webui and gpt4all for general purpose chat. There are also KoboldAI and SillyTavern, they have focus more on storytelling and roleplay and have tools to improve that.

And finally the folks from the KoboldAi do some interesting stuff with Pseudocode and Soft-Prompts that might also be relevant.

Click this link. ---> https://github.com/KoboldAI/KoboldAI-Client/tree/main

Do you believe the problem could be that my KoboldAI is outdated? I did download the one from henk717 at https://github.com/KoboldAI/KoboldAI-Client but it was a little while ago.