Llama-cpp-rs Alternatives

Similar projects and alternatives to llama-cpp-rs

• text-generation-webui

  876 36,827 9.9 Python llama-cpp-rs VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• ollama

  209 66,540 9.9 Go llama-cpp-rs VS ollama

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• mlx

  23 14,739 9.8 C++ llama-cpp-rs VS mlx

  MLX: An array framework for Apple silicon

  

• jan

  16 18,232 10.0 TypeScript llama-cpp-rs VS jan

  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

  

• llm_steer-oobabooga

  4 30 6.6 Python llama-cpp-rs VS llm_steer-oobabooga

  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vectors, now in oobabooga text generation webui!

• transformerlab-app

  3 205 9.7 TypeScript llama-cpp-rs VS transformerlab-app

  Experiment with Large Language Models

  

• llm-chatbot-rag

  1 33 6.1 Jupyter Notebook llama-cpp-rs VS llm-chatbot-rag

  A local LLM chatbot with RAG for PDF input files

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• chat-with-doc

  1 1 5.1 Python llama-cpp-rs VS chat-with-doc

  A Web application that enables users to upload documents and engage in conversational analysis with self-hosted large language models (LLMs) deployed on Ollama.