LibreChat VS linktree-clone-angular

Note this slight issue if you try this at home

RunPod is a popular service that allows you to rent GPU hours on-demand. While they might not be the best option and they also have other plans, those are out of the scope of this article. This article will cover how to host models on the cloud, from choosing the models you want to sending requests to your own pod with LibreChat.

I'm looking to provide our 4-person team access to various LLMs, including OpenAI, Anthropic, Meta's Llama, and some others.

I want to have browser-based UI (like ChatGPT) to upload files and get Markdown-reponses with price control to avoid unexpected high costs at the end of the month.

My current plan is to purchase API keys from different LLM providers and use LiteLLM as a proxy to setup cost limits OR to use OpenRouter.ai (potentially still using LiteLLM).

LibreChat currently doesn't support "passing through" uploads, but this feature is expected to be implemented this week: https://github.com/danny-avila/LibreChat/discussions/3760#discussioncomment-10445600

My Questions:

Is my approach using LiteLLM or OpenRouter with a UI a viable solution? I believe this could be more cost-effective than purchasing monthly chat accounts for each of the four users.

Are there other UIs similar to ChatGPT and Anthropic's interfaces, for the case that the LibreChat feature is too instable?

A better question would be over something like Jan or LibreChat. Ollama's is CLI/API/backend for easily downloading and running models.

https://github.com/janhq/jan

https://github.com/danny-avila/LibreChat

Jan's probably the closest thing to a open-source LLM chat interface that is relatively easy to get started with.

I personally prefer Librechat (which supports integration with image generation) but it does have to spin up some docker stuff and that can make it a bit more complicated.

Pretty much all of the features you mention are already in LibreChat (MIT License). If you don't mind self-hosting, then it has branching, convo search, change models mid-chat, "presets" (save system prompts), and a whole lot more. I've deployed it in my gov agency for months now, and I've had amazing feedback. https://github.com/danny-avila/LibreChat

Better Azure OpenAI and OpenAI support, as well as API based AI services

Better Azure OpenAI and OpenAI support, as well as API based AI services

Repo Link: GitHub - manthanank/linktree-clone-angular: Linktree Clone in Angular