Koboldcpp Alternatives

Similar projects and alternatives to koboldcpp

• stable-diffusion-webui

  2,808 128,662 9.9 Python koboldcpp VS stable-diffusion-webui

  Stable Diffusion web UI

• text-generation-webui

  876 35,583 9.9 Python koboldcpp VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• llama.cpp

  766 55,117 9.9 C++ koboldcpp VS llama.cpp

  LLM inference in C/C++

• ollama

  187 55,134 9.9 Go koboldcpp VS ollama

  Get up and running with Llama 2, Mistral, Gemma, and other large language models.

  

• KoboldAI-Client

  185 3,332 6.3 Python koboldcpp VS KoboldAI-Client

• gpt4all

  139 63,641 9.8 C++ koboldcpp VS gpt4all

  gpt4all: run open-source LLMs anywhere

  

• mlc-llm

  89 16,622 9.9 Python koboldcpp VS mlc-llm

  Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• FastChat

  82 33,464 9.7 Python koboldcpp VS FastChat

  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  

• SillyTavern

  75 677 10.0 JavaScript koboldcpp VS SillyTavern

  Discontinued LLM Frontend for Power Users. [Moved to: https://github.com/SillyTavern/SillyTavern] (by Cohee1207)

  

• SillyTavern

  76 5,697 10.0 JavaScript koboldcpp VS SillyTavern

  LLM Frontend for Power Users.

  

• exllama

  64 2,566 9.0 Python koboldcpp VS exllama

  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

• KoboldAI

  58 148 8.6 Python koboldcpp VS KoboldAI

• lm-evaluation-harness

  34 4,848 9.9 Python koboldcpp VS lm-evaluation-harness

  A framework for few-shot evaluation of language models.

  

• simple-proxy-for-tavern

  21 110 8.0 JavaScript koboldcpp VS simple-proxy-for-tavern

• Local-LLM-Comparison-Colab-UI

  20 859 9.1 Jupyter Notebook koboldcpp VS Local-LLM-Comparison-Colab-UI

  Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

• TavernAI

  17 76 10.0 JavaScript koboldcpp VS TavernAI

  Discontinued TavernAI for nerds [Moved to: https://github.com/Cohee1207/SillyTavern] (by SillyLossy)

• exllamav2

  16 2,827 9.8 Python koboldcpp VS exllamav2

  A fast inference library for running LLMs locally on modern consumer-class GPUs

• rwkv.cpp

  12 1,094 7.6 C++ koboldcpp VS rwkv.cpp

  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

  

• runpodctl

  8 211 9.4 Go koboldcpp VS runpodctl

  🧰 | RunPod CLI for pod management

  

• HeuristicImperatives

  8 114 10.0 Python koboldcpp VS HeuristicImperatives

  Discontinued Reduce suffering, increase prosperity, increase understanding. A proposed framework to address the Control Problem.

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives