gpt-llama.cpp VS Instrukt

hi! I really like the solution https://github.com/keldenl/gpt-llama.cpp which helps to deploy https://github.com/mckaywrigley/chatbot-ui on the local model. I am running this together with Wizard7b or 13b locally and it works fine, but when I tried to upload to a remote server I met an error.

sounds like you’re asking for exactly this? https://github.com/keldenl/gpt-llama.cpp

I salut you good sir. This is an amazing idea. I don't have time but it will be interesting idea to use this wrapper https://github.com/keldenl/gpt-llama.cpp which simulates GPT endpoint for local lama, so basically we can have amazing tool for completely free use. If somebody test it please let me know underneath my comment!

I would gladly buy your product to run with a local model, like Vicuna ggml , also see https://github.com/keldenl/gpt-llama.cpp/

possible through fastllama in python or gpt-llama.cpp an API wrapper around llama.cpp

https://github.com/keldenl/gpt-llama.cpp supports embeddings, and it even takes in openai type requests and returns openai compatible responses!

https://github.com/keldenl/gpt-llama.cpp

There's a (kind of) working Auto-GPT solution that uses Vicuna https://github.com/keldenl/gpt-llama.cpp/blob/master/docs/Auto-GPT-setup-guide.md

Here's the link https://github.com/blob42/Instrukt where I will share the code in the upcoming the days.

Adding this one to the list: https://github.com/blob42/Instrukt

Hi, I am the person making this tool. Checkout https://github.com/blob42/Instrukt for more info.