dockerLLM Alternatives

Similar projects and alternatives to dockerLLM

• text-generation-webui

  876 36,827 9.9 Python dockerLLM VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  780 57,984 10.0 C++ dockerLLM VS llama.cpp

  LLM inference in C/C++

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• koboldcpp

  180 3,951 10.0 C++ dockerLLM VS koboldcpp

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

• open_llama

  52 7,211 5.3 dockerLLM VS open_llama

  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

  

• alpaca_lora_4bit

  41 529 8.6 Python dockerLLM VS alpaca_lora_4bit

• lm-evaluation-harness

  34 5,211 9.9 Python dockerLLM VS lm-evaluation-harness

  A framework for few-shot evaluation of language models.