agency
koboldcpp
| agency | koboldcpp | |
|---|---|---|
| 3 | 184 | |
| 431 | 7,793 | |
| 1.2% | 4.8% | |
| 7.4 | 10.0 | |
| 8 days ago | about 20 hours ago | |
| Python | C++ | |
| MIT License | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
agency
-
Is it possible to make two LLMs talk to each other?
Check out this project, the author is around here: https://github.com/operand/agency
-
Update on my new agent library, now called `agency`
First, I renamed the project to agency. Much better I think!
- This is getting really complicated.
koboldcpp
-
LM Studio is now an MCP Host
Oh, that horrible Electron UI. Under Windows it pegs a core on my CPU at all times!
If you're just working as a single user via the OpenAI protocol, you might want to consider koboldcpp. It bundles a GUI launcher, then starts in text-only mode. You can also tell it to just run a saved configuration, bypassing the GUI; I've successfully run it as a system service on Windows using nssm.
https://github.com/LostRuins/koboldcpp/releases
Though there are a lot of roleplay-centric gimmicks in its feature set, its context-shifting feature is singular. It caches the intermediate state used by your last query, extending it to build the next one. As a result you save on generation time with large contexts, and also any conversation that has been pushed out of the context window still indirectly influences the current exchange.
- LostRuins/koboldcpp: Run GGUF models easily with a KoboldAI UI
-
Hosting HuggingFace Models with KoboldCpp and RunPod
KoboldCpp is a popular text generation software for GGML and GGUF models. It also comes with an OpenAI-compatible API endpoint when serving a model, which makes it easy to use with LibreChat and other software that can connect to OpenAI-compatible endpoints.
- AMD Inference
- Any Online Communities on Local/Home AI?
- Koboldcpp-1.62.1 adds support for Command-R+
- Show HN: I made an app to use local AI as daily driver
-
Easiest way to show my model to my mom?
FYI this is the easiest way to host on the horde: https://github.com/LostRuins/koboldcpp
- IT Veteran... why am I struggling with all of this?
- What do you use to run your models?
What are some alternatives?
Autonomous-Agents - Autonomous Agents (LLMs) research papers. Updated Daily.
ollama - Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.
chatarena - ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.
text-generation-webui - LLM UI with advanced features, easy setup, and multiple backend support.
rosa - ROSA 🤖 is an AI Agent designed to interact with ROS1- and ROS2-based robotics systems using natural language queries. ROSA helps robot developers inspect, diagnose, understand, and operate robots.
KoboldAI