FastChat Alternatives

Similar projects and alternatives to FastChat

• text-generation-webui

  876 35,862 9.9 Python FastChat VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  769 55,846 10.0 C++ FastChat VS llama.cpp

  LLM inference in C/C++

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• PostgreSQL

  405 14,673 10.0 C FastChat VS PostgreSQL

  Mirror of the official PostgreSQL GIT repository. Note that this is just a *mirror* - we don't work with pull requests on github. To contribute, please see https://wiki.postgresql.org/wiki/Submitting_a_Patch

  

• Pytorch

  336 77,783 10.0 Python FastChat VS Pytorch

  Tensors and Dynamic neural networks in Python with strong GPU acceleration

  

• ollama

  192 58,943 9.9 Go FastChat VS ollama

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

• llama

  184 52,603 8.1 Python FastChat VS llama

  Inference code for Llama models

  

• koboldcpp

  180 3,749 10.0 C++ FastChat VS koboldcpp

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• gpt4all

  139 64,046 9.8 C++ FastChat VS gpt4all

  gpt4all: run open-source LLMs anywhere

  

• stanford_alpaca

  108 28,761 2.0 Python FastChat VS stanford_alpaca

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  

• alpaca-lora

  107 18,167 3.6 Jupyter Notebook FastChat VS alpaca-lora

  Instruct-tune LLaMA on consumer hardware

• alpaca.cpp

  94 9,878 9.4 C FastChat VS alpaca.cpp

  Discontinued Locally run an Instruction-Tuned Chat-Style LLM

• mlc-llm

  89 16,774 9.9 Python FastChat VS mlc-llm

  Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

  

• LocalAI

  82 19,593 9.9 C++ FastChat VS LocalAI

  :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

  

• FLiPStackWeekly

  79 14 9.9 FastChat VS FLiPStackWeekly

  FLaNK AI Weekly covering Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Ozone, Apache Pulsar, and more...

• llama-cpp-python

  54 6,378 9.9 Python FastChat VS llama-cpp-python

  Python bindings for llama.cpp

• open_llama

  52 7,193 5.3 FastChat VS open_llama

  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

  

• litellm

  28 8,225 10.0 Python FastChat VS litellm

  Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

  

• OpenLLM

  25 8,733 9.9 Python FastChat VS OpenLLM

  Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint, locally and in the cloud.

  

• bitsandbytes

  61 5,389 9.4 Python FastChat VS bitsandbytes

  Accessible large language models via k-bit quantization for PyTorch.

• CASALIOY

  6 231 8.7 Python FastChat VS CASALIOY

  ♾️ toolkit for air-gapped LLMs on consumer-grade hardware

  

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives