Gpt4all.cpp Alternatives

Similar projects and alternatives to gpt4all.cpp

• text-generation-webui

  876 36,827 9.9 Python gpt4all.cpp VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  777 57,984 10.0 C++ gpt4all.cpp VS llama.cpp

  LLM inference in C/C++

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• whisper.cpp

  187 31,649 9.8 C gpt4all.cpp VS whisper.cpp

  Port of OpenAI's Whisper model in C/C++

• alpaca.cpp

  94 9,878 9.4 C gpt4all.cpp VS alpaca.cpp

  Discontinued Locally run an Instruction-Tuned Chat-Style LLM

• RWKV-LM

  84 11,704 8.8 Python gpt4all.cpp VS RWKV-LM

  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

• FastChat

  83 34,514 9.6 Python gpt4all.cpp VS FastChat

  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  

• llm

  41 5,931 9.4 Rust gpt4all.cpp VS llm

  An ecosystem of Rust libraries for working with large language models

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• rwkv.cpp

  12 1,111 6.8 C++ gpt4all.cpp VS rwkv.cpp

  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

  

• cformers

  4 314 6.7 C gpt4all.cpp VS cformers

  SoTA Transformers with C-backend for fast inference on your CPU.