FastChat Alternatives

Similar projects and alternatives to FastChat

• text-generation-webui

  14 14,364 9.7 Python FastChat VS text-generation-webui

  A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.

• llama.cpp

  13 28,932 9.8 C FastChat VS llama.cpp

  Port of Facebook's LLaMA model in C/C++

• Sonar

  www.sonarsource.com

  sponsored

  Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  

• gpt4all

  5 43,766 9.6 C++ FastChat VS gpt4all

  gpt4all: an ecosystem of open-source chatbots trained on a massive collections of clean assistant data including code, stories and dialogue

  

• llama

  6 22,661 7.5 Python FastChat VS llama

  Inference code for LLaMA models

  

• bitsandbytes

  - 2,466 8.0 Python FastChat VS bitsandbytes

  8-bit CUDA functions for PyTorch

• dalai

  - 11,761 9.5 CSS FastChat VS dalai

  The simplest way to run LLaMA on your local machine

• alpaca-lora

  5 15,010 9.5 Jupyter Notebook FastChat VS alpaca-lora

  Instruct-tune LLaMA on consumer hardware

• InfluxDB

  www.influxdata.com

  sponsored

  Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

  

• LocalAI

  3 5,596 10.0 Go FastChat VS LocalAI

  :robot: Self-hosted, community-driven, local OpenAI-compatible API. Drop-in replacement for OpenAI running LLMs on consumer-grade hardware. No GPU required. LocalAI is a RESTful API to run ggml compatible models: llama.cpp, alpaca.cpp, gpt4all.cpp, rwkv.cpp, whisper.cpp, vicuna, koala, gpt4all-j, cerebras and many others!

  

• Auto-GPT

  - 137,216 9.9 Python FastChat VS Auto-GPT

  An experimental open-source attempt to make GPT-4 fully autonomous.

  

• CASALIOY

  4 165 10.0 Python FastChat VS CASALIOY

  CASALIOY ♾️ The best toolkit for air-gapped LLMs on consumer-grade hardware

• open_llama

  3 3,941 7.7 FastChat VS open_llama

  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

  

• MiniGPT-4

  - 19,967 9.1 Python FastChat VS MiniGPT-4

  MiniGPT-4: Enhancing Vision-language Understanding with Advanced Large Language Models

  

• stanford_alpaca

  3 24,420 8.8 Python FastChat VS stanford_alpaca

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  

• alpaca.cpp

  2 9,878 9.4 C FastChat VS alpaca.cpp

  Locally run an Instruction-Tuned Chat-Style LLM

• RWKV-LM

  2 7,913 5.3 Python FastChat VS RWKV-LM

  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

• mlc-llm

  2 7,407 9.0 Python FastChat VS mlc-llm

  Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

  

• open-llms

  2 6,105 9.2 FastChat VS open-llms

  🤖 A list of open LLMs available for commercial use.

• web-llm

  2 6,091 8.9 TypeScript FastChat VS web-llm

  Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.

  

• llama-cpp-python

  2 1,368 9.8 Python FastChat VS llama-cpp-python

  Python bindings for llama.cpp

• koboldcpp

  2 847 9.9 C FastChat VS koboldcpp

  A simple one-file way to run various GGML models with KoboldAI's UI

• SaaSHub

  www.saashub.com

  sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives