LibreChat VS ollama-webui

Better Azure OpenAI and OpenAI support, as well as API based AI services

Better Azure OpenAI and OpenAI support, as well as API based AI services

Good to know, thanks!

I still find it a bit concerning that even the LibreChat docs about LiteLLM don't mention local models in the list of use cases. It looks like there's a GitHub ticket to add that to the docs [0], which would be good.

Maybe I'm just growing old and crotchety, but it makes me uncomfortable to see a word like Libre—which was specifically coined in English to differentiate itself from Free-as-in-Beer—used in a context where monetary cost seems to be the primary concern in the maintainers' minds.

[0] https://github.com/danny-avila/LibreChat/issues/1131

The author of LibreChat [0] teaserd on discord that he's working on one. LibreChat is already the best "chatgpt ui" clone I could find (it has some rough edges, but not as many as the official chatgpt ui).

[0] https://github.com/danny-avila/librechat

Was also recently discussed here https://news.ycombinator.com/item?id=38502805

Check it out here if you're interested (I have no association): https://github.com/danny-avila/LibreChat

We use an Open AI developer account and an installation of LibreChat connected to our Azure AD for authentication.

LibreChat

i find LibreChat much better. The devs are very responsive as well to bugs and updates.

I'm a podman beginner, trying to install ollama-webui(1) using Podman on M2 MBA.

I started up Podman Desktop, and did a terminal command "docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v ollama-webui:/app/backend/data --name ollama-webui --restart always ghcr.io/ollama-webui/ollama-webui:main" based on Github's instructions, but it gave a error message something about "host".

Do you know what is the problem and how do I overcome this?

If I run the above command using Docker Desktop, it runs and installs Ollama-WebUI just fine.

(1) https://github.com/ollama-webui/ollama-webui ("Installing with Docker")

Thank you.

I set up Ollama in a docker container (really easy) and I use the Ollama web-ui here, that's very much like ChatGPT, and I have that in a container as well.

The primary use case here seems to be that it might be possible to use this tool to spend <$20/mo for the same feature set as ChatGPT+. It does not currently make any effort to support locally-hosted open source models, which is what I would have assumed from its name.

If you're interested in a fully Libre LLM stack, I've had fun lately with ollama [0] and ollama-webui [1]. It was pretty trivial to take ollama-webui's docker-compose file and set up a locally-running chat server with Mistral 7B. Trying out different models and prompts was likewise very easy to get started with.

Mistral isn't anything like as good as GPT-4, but it's Apache licensed and fully local, which meets my definition of Libre. I'll continue to use both while the FOSS stacks catch up, but it's fun to keep up with the progress on the open source stuff as tooling develops.

[0] https://github.com/jmorganca/ollama

[1] https://github.com/ollama-webui/ollama-webui