gpt-code-ui VS simple-proxy-for-tavern

Is this of any help?

I’m interested in hooking up WizardCoder to https://github.com/ricklamers/gpt-code-ui

Unfortunately, not out of the box. But currently it is doable, it is just a matter of someone creating a plugin for it, perhaps someone could leverage, as u/PartySunday mentioned, https://github.com/ricklamers/gpt-code-ui. The only limitation is the ability to upload local files, definitely something to consider after releasing https://www.openplugin.io/

There’s an open source project to accomplish this here: https://github.com/ricklamers/gpt-code-ui

However, I haven’t vetted it.

I am currently working on releasing this open source but wanted to deploy it first to my Discord bot. Follow me on Twitter for updates ;) In case you want something open-source now a friend made this project on GitHub which is similar :D

If you're interested I recently found this project that let's you use your API key and emulates code interpreter https://github.com/ricklamers/gpt-code-ui

An open source implementation of OpenAI's ChatGPT Code interpreter

Been using 1.9 for a while now, but heard about all the nice new extras in 1.1 so I decided to upgrade today. Silly me! Well ST Itself is running fine I've got that up no issues, extras is installed and koboldcpp is up to date...but it won't connect ST to KCPP. That being https://github.com/anon998/simple-proxy-for-tavern. It's worked like a dream for weeks up until today when I went to update and now the two can't talk. I did a fresh git pull of a new version - nothing. Rolled back to 1.9.7 - and it works like a charm. Anyone else had these issues?

https://github.com/anon998/simple-proxy-for-tavern/issues/25 It threw this error at me for a moment when I tried open AI, but not when running my Local LLM Via Kobold.

Still, nothing beats the SillyTavern + simple-proxy-for-tavern setup for me. But currently there's even a known issue with that and koboldcpp regarding sampler order used in the proxy presets (PR for fix is waiting to be merged, until it's merged, manually changing the presets may be required).

I’m using this https://github.com/anon998/simple-proxy-for-tavern

SillyTavern is just a frontend so it's as fast or slow as your backend. With simple-proxy-for-tavern you can use llama.cpp directly, no Python involved, so SillyTavern will be as fast as llama.cpp itself.

I also use the simple-proxy-for-tavern in between koboldcpp and the frontend, which does some magic behind the scenes to improve things further. Takes some time to understand and configure it all, but once done, it's definitely worth the effort, as nothing beats that setup for roleplaying and chat.

Really? Then we definitely have different experiences (or different ways to interact) with Guanaco. It's been the most unrestricted model I've tried, and I tried them all, but I'm using SillyTavern and the simple-proxy-for-tavern which combined with a little prompting liberates basically any model.

Why reinvent the wheel? Just use SillyTavern, ideally with the simple-proxy-for-tavern. That does it all, and more.