Bad PDFs = bad UX. Slow load times, broken annotations, clunky UX frustrates users. Nutrient’s PDF SDKs gives seamless document experiences, fast rendering, annotations, real-time collaboration, 100+ features. Used by 10K+ devs, serving ~half a billion users worldwide. Explore the SDK for free. Learn more →
Anything-llm Alternatives
Similar projects and alternatives to anything-llm
-
-
CodeRabbit
CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
-
ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models.
-
-
txtai
💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
-
-
-
khoj
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.
-
Nutrient
Nutrient - The #1 PDF SDK Library. Bad PDFs = bad UX. Slow load times, broken annotations, clunky UX frustrates users. Nutrient’s PDF SDKs gives seamless document experiences, fast rendering, annotations, real-time collaboration, 100+ features. Used by 10K+ devs, serving ~half a billion users worldwide. Explore the SDK for free.
-
-
-
h2ogpt
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/
-
-
-
-
-
-
azure-search-openai-demo
A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.
-
privateGPT
Discontinued Interact with your documents using the power of GPT, 100% privately, no data leaks [Moved to: https://github.com/zylon-ai/private-gpt]
-
-
LLMStack
No-code multi-agent framework to build LLM Agents, workflows and applications with your data
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
anything-llm discussion
anything-llm reviews and mentions
-
Bringing K/V context quantisation to Ollama
Anything LLM - https://anythingllm.com/. Liked the workspace concept in it. We can club documents in workspaces and RAG scope is managed.
-
open-webui VS anything-llm - a user suggested alternative
2 projects | 1 Dec 2024
-
Writing an AnythingLLM Custom Agent Skill to Trigger Make.com Webhooks
Recently I've been experimenting with running a local Llama.cpp Server and looking for 3rd party applications to connect to it. It seems like there are have been a lot of popular solutions to running models downloaded from Huggingface locally, but many of them seem to want to import the model themselves using the Llama.cpp or Ollama libraries instead of connecting to an external provider. I'm more interested in using this technology as a server so that I start it once and allow clients to connect to it without needing to shutdown and go through the long, resource intensive, start-up process of each application. One of the applications that I've found great for chatting with in my setup is AnythingLLM.
-
AI-assisted writing: LM Studio vs Microsoft Copilot in Word
In general, such RAG features can be achieved by combining LLM Server and Vector Database. I plan to demonstrate this further by using AnythingLLM for vector database and LM Studio as its LLM provider in a future post. The main advantage in this local approach is that you can reference as many files as your hardware allows.
-
Building Your Private ChatGPT and Knowledge Base with AnythingLLM and GPUStack
AnythingLLM [https://github.com/Mintplex-Labs/anything-llm] is an all-in-one AI application that runs on Mac, Windows, and Linux. Its goal is to enable the local creation of a personal ChatGPT using either commercial or open-source LLMs along with vector database solutions. AnythingLLM goes beyond being a simple chatbot by including Retrieval-Augmented Generation (RAG) and Agent capabilities. These features allow it to perform a variety of tasks, such as fetching website information, generating charts, summarizing documents, and more.
- Claude for Desktop
-
Ask HN: Local RAG with private knowledge base
I'm very interested in checking something like this out for getting to grips with a local codebase of unfamiliar SQL and assorted scripts and reports.
I have a few tabs open that I haven't had a chance to try:
https://github.com/Mintplex-Labs/anything-llm
https://github.com/Bin-Huang/chatbox
https://github.com/saeedezzati/superpower-chatgpt
-
AIM Weekly 09 Sept 2024
📎 Mistral Nemo 🤖 Evaluating LLM Conversations 📊 Building with NVIDIA and Milvus 📱 Rag Evaluation using Ragas 🖥️ AnythingLLM 📢 RDBMS vs Vector DB 🖥️ LLMWare 🐦🔥NIM Agent Buildprints
- Show HN: AnythingLLM – The Open-Source, All-in-One Desktop AI Assistant
-
Show HN: Site2pdf
Thanks for taking the time to respond. I was thinking of something local, especially in light of:
Google's Gemini AI caught scanning Google Drive PDF files without permission https://news.ycombinator.com/item?id=40965892 .
Looks like GPT4All[1] and AnythingLLM[2] are worth exploring. There's also the closed-source macOS app RecurseChat[3,4] which appeared on HN a few months ago[5].
[1] https://github.com/nomic-ai/gpt4all
[2] https://github.com/Mintplex-Labs/anything-llm
[3] https://recurse.chat
[4] https://recurse.chat/blog/posts/local-docs
[5] https://news.ycombinator.com/item?id=39532367
-
A note from our sponsor - Nutrient
nutrient.io | 18 Feb 2025
Stats
Mintplex-Labs/anything-llm is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of anything-llm is JavaScript.