Llama-tools Alternatives

Similar projects and alternatives to llama-tools

• text-generation-webui

  876 36,827 9.9 Python llama-tools VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  777 57,984 10.0 C++ llama-tools VS llama.cpp

  LLM inference in C/C++

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• FastChat

  83 34,514 9.6 Python llama-tools VS FastChat

  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  

• bitsandbytes

  61 5,482 9.4 Python llama-tools VS bitsandbytes

  Accessible large language models via k-bit quantization for PyTorch.

• dalai

  59 13,060 6.5 CSS llama-tools VS dalai

  The simplest way to run LLaMA on your local machine

• rllama

  7 520 6.2 Rust llama-tools VS rllama

  Rust+OpenCL+AVX2 implementation of LLaMA inference code

• ai-guide

  4 112 10.0 llama-tools VS ai-guide

  Discontinued A guide for getting started with FOSS text generation.

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives