What's the difference between oobabooga vs llama.cpp vs fastgpt

• llama.cpp

  769 56,891 10.0 C++

  LLM inference in C/C++

• text-generation-webui

  876 36,293 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• FastChat

  82 33,877 9.6 Python

  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  

• alpaca.cpp

  94 9,878 9.4 C

  Discontinued Locally run an Instruction-Tuned Chat-Style LLM

• gpt4all.cpp

  2 510 6.5 C

  Locally run an Assistant-Tuned Chat-Style LLM

• llm

  41 5,885 9.4 Rust

  An ecosystem of Rust libraries for working with large language models

  

Suggest a related project