LibreChat
llama.cpp
LibreChat | llama.cpp | |
---|---|---|
22 | 773 | |
11,010 | 56,891 | |
- | - | |
9.8 | 10.0 | |
about 5 hours ago | 4 days ago | |
TypeScript | C++ | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
LibreChat
- Integra múltiples APIs de IA en una sola plataforma
-
text-generation-webui VS LibreChat - a user suggested alternative
2 projects | 29 Feb 2024
Better Azure OpenAI and OpenAI support, as well as API based AI services
-
open-webui VS LibreChat - a user suggested alternative
2 projects | 29 Feb 2024
Better Azure OpenAI and OpenAI support, as well as API based AI services
-
LibreChat
Good to know, thanks!
I still find it a bit concerning that even the LibreChat docs about LiteLLM don't mention local models in the list of use cases. It looks like there's a GitHub ticket to add that to the docs [0], which would be good.
Maybe I'm just growing old and crotchety, but it makes me uncomfortable to see a word like Libre—which was specifically coined in English to differentiate itself from Free-as-in-Beer—used in a context where monetary cost seems to be the primary concern in the maintainers' minds.
[0] https://github.com/danny-avila/LibreChat/issues/1131
-
Ask HN: Should I subscribe to ChatGPT Plus if we can get it for free on Bing?
The author of LibreChat [0] teaserd on discord that he's working on one. LibreChat is already the best "chatgpt ui" clone I could find (it has some rough edges, but not as many as the official chatgpt ui).
[0] https://github.com/danny-avila/librechat
Was also recently discussed here https://news.ycombinator.com/item?id=38502805
-
GPT-4 is pissing me off
Check it out here if you're interested (I have no association): https://github.com/danny-avila/LibreChat
-
Seeking Insights on ChatGPT Enterprise Subscription Plan for Team Upgrade
We use an Open AI developer account and an installation of LibreChat connected to our Azure AD for authentication.
-
Good alternative for Claude? GPT4 sign ups are locked right now due to high demand :(
LibreChat
-
GUI for the OpenAI API?
i find LibreChat much better. The devs are very responsive as well to bugs and updates.
llama.cpp
- Llama.cpp Bfloat16 Support
-
Fine-tune your first large language model (LLM) with LoRA, llama.cpp, and KitOps in 5 easy steps
Getting started with LLMs can be intimidating. In this tutorial we will show you how to fine-tune a large language model using LoRA, facilitated by tools like llama.cpp and KitOps.
- GGML Flash Attention support merged into llama.cpp
-
Phi-3 Weights Released
well https://github.com/ggerganov/llama.cpp/issues/6849
- Lossless Acceleration of LLM via Adaptive N-Gram Parallel Decoding
- Llama.cpp Working on Support for Llama3
-
Embeddings are a good starting point for the AI curious app developer
Have just done this recently for local chat with pdf feature in https://recurse.chat. (It's a macOS app that has built-in llama.cpp server and local vector database)
Running an embedding server locally is pretty straightforward:
- Get llama.cpp release binary: https://github.com/ggerganov/llama.cpp/releases
- Mixtral 8x22B
- Llama.cpp: Improve CPU prompt eval speed
-
Ollama 0.1.32: WizardLM 2, Mixtral 8x22B, macOS CPU/GPU model split
Ah, thanks for this! I can't edit my parent comment that you replied to any longer unfortunately.
As I said, I only compared the contributors graphs [0] and checked for overlaps. But those apparently only go back about year and only list at most 100 contributors ranked by number of commits.
[0]: https://github.com/ollama/ollama/graphs/contributors and https://github.com/ggerganov/llama.cpp/graphs/contributors
What are some alternatives?
ollama-webui - ChatGPT-Style WebUI for LLMs (Formerly Ollama WebUI) [Moved to: https://github.com/open-webui/open-webui]
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
koboldcpp - A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
gpt4all - gpt4all: run open-source LLMs anywhere
askai - Command Line Interface for OpenAi ChatGPT
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
ChatGPT - Multiple chats completions simultaneously 😲 Send chat with/without history 🧐 Image generation 🎨 Choose model from a variety of GPT-3/GPT-4 models 😃 Stores your chats in local storage 👀 Same user interface as the original ChatGPT 📺 Custom chat titles 💬 Export/Import your chats 🔼🔽 Code Highlight
GPTQ-for-LLaMa - 4 bits quantization of LLaMA using GPTQ
chat-with-gpt - An open-source ChatGPT app with a voice
ggml - Tensor library for machine learning
integrate-palm-into-word - How to use Google's PaLM 2 language model in Microsoft Word.
alpaca.cpp - Locally run an Instruction-Tuned Chat-Style LLM