Llama Alternatives

Similar projects and alternatives to llama

• text-generation-webui

  876 36,293 9.9 Python llama VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  769 56,891 10.0 C++ llama VS llama.cpp

  LLM inference in C/C++

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• whisper.cpp

  187 31,174 9.8 C llama VS whisper.cpp

  Port of OpenAI's Whisper model in C/C++

• llama

  184 53,053 8.1 Python llama VS llama

  Inference code for Llama models

  

• SHARK

  84 1,382 9.4 Python llama VS SHARK

  SHARK - High Performance Machine Learning Distribution

  

• GPTQ-for-LLaMa

  75 2,913 8.6 Python llama VS GPTQ-for-LLaMa

  4 bits quantization of LLaMA using GPTQ

• tinygrad

  58 17,800 9.7 Python llama VS tinygrad

  Discontinued You like pytorch? You like micrograd? You love tinygrad! ❤️ [Moved to: https://github.com/tinygrad/tinygrad] (by geohot)

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• amx

  18 851 4.1 C llama VS amx

  Apple AMX Instruction Set

• llama-dl

  17 3,386 8.8 Shell llama VS llama-dl

  Discontinued High-speed download of LLaMA, Facebook's 65B parameter GPT model [UnavailableForLegalReasons - Repository access blocked]

• sentencepiece

  19 9,480 8.1 C++ llama VS sentencepiece

  Unsupervised text tokenizer for Neural Network-based text generation.

  

• llama-mps

  4 83 3.8 Python llama VS llama-mps

  Experimental fork of Facebooks LLaMa model which runs it with GPU acceleration on Apple Silicon M1/M2

• llama

  3 35 1.6 llama VS llama

  Inference code for LLaMA models (by gmorenz)