Llama-mps Alternatives

Similar projects and alternatives to llama-mps

• text-generation-webui

  876 36,293 9.9 Python llama-mps VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  769 56,891 10.0 C++ llama-mps VS llama.cpp

  LLM inference in C/C++

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• llama

  184 53,053 8.1 Python llama-mps VS llama

  Inference code for Llama models

  

• whisper.cpp

  187 31,174 9.8 C llama-mps VS whisper.cpp

  Port of OpenAI's Whisper model in C/C++

• KoboldAI-Client

  185 3,344 6.3 Python llama-mps VS KoboldAI-Client

• transformers

  175 125,021 10.0 Python llama-mps VS transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  

• SHARK

  84 1,382 9.4 Python llama-mps VS SHARK

  SHARK - High Performance Machine Learning Distribution

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• GPTQ-for-LLaMa

  75 2,913 8.6 Python llama-mps VS GPTQ-for-LLaMa

  4 bits quantization of LLaMA using GPTQ

• tinygrad

  58 17,800 9.7 Python llama-mps VS tinygrad

  Discontinued You like pytorch? You like micrograd? You love tinygrad! ❤️ [Moved to: https://github.com/tinygrad/tinygrad] (by geohot)

  

• awesome-ml

  27 1,402 8.8 llama-mps VS awesome-ml

  Curated list of useful LLM / Analytics / Datascience resources

• llama-dl

  17 3,386 8.8 Shell llama-mps VS llama-dl

  Discontinued High-speed download of LLaMA, Facebook's 65B parameter GPT model [UnavailableForLegalReasons - Repository access blocked]

• sentencepiece

  19 9,480 8.1 C++ llama-mps VS sentencepiece

  Unsupervised text tokenizer for Neural Network-based text generation.

  

• amx

  18 851 4.1 C llama-mps VS amx

  Apple AMX Instruction Set

• one-click-installers

  18 470 8.9 Python llama-mps VS one-click-installers

  Discontinued Simplified installers for oobabooga/text-generation-webui.

• llama

  3 35 1.6 llama-mps VS llama

  Inference code for LLaMA models (by gmorenz)

• llama-cpu

  9 775 3.1 Python llama-mps VS llama-cpu

  Fork of Facebooks LLaMa model to run on CPU

• LLaMA_MPS

  4 566 10.0 Python llama-mps VS LLaMA_MPS

  Discontinued Run LLaMA inference on Apple Silicon GPUs.

• tinygrad

  17 23,864 10.0 Python llama-mps VS tinygrad

  You like pytorch? You like micrograd? You love tinygrad! ❤️

  

• bitsandbytes-win-prebuilt

  4 75 10.0 llama-mps VS bitsandbytes-win-prebuilt

• llama

  1 189 2.8 Python llama-mps VS llama

  Inference code for LLaMA models (by shawwn)

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives