Llama-cpu Alternatives

Similar projects and alternatives to llama-cpu

• text-generation-webui

  876 35,862 9.9 Python llama-cpu VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama

  184 52,603 8.1 Python llama-cpu VS llama

  Inference code for Llama models

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• KoboldAI-Client

  185 3,344 6.3 Python llama-cpu VS KoboldAI-Client

• transformers

  175 125,021 10.0 Python llama-cpu VS transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  

• petals

  98 8,661 8.5 Python llama-cpu VS petals

  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

  

• GPTQ-for-LLaMa

  75 2,913 8.6 Python llama-cpu VS GPTQ-for-LLaMa

  4 bits quantization of LLaMA using GPTQ

• DeepSpeed

  51 32,550 9.8 Python llama-cpu VS DeepSpeed

  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• FlexGen

  39 8,999 3.0 Python llama-cpu VS FlexGen

  Running large language models on a single GPU for throughput-oriented scenarios.

  

• awesome-ml

  27 1,383 9.1 llama-cpu VS awesome-ml

  Curated list of useful LLM / Analytics / Datascience resources

• one-click-installers

  18 470 8.9 Python llama-cpu VS one-click-installers

  Discontinued Simplified installers for oobabooga/text-generation-webui.

• bitsandbytes-win-prebuilt

  4 75 10.0 llama-cpu VS bitsandbytes-win-prebuilt

• wrapyfi-examples_llama

  2 128 4.0 Python llama-cpu VS wrapyfi-examples_llama

  Inference code for facebook LLaMA models with Wrapyfi support

  

• fickling

  7 322 8.6 Python llama-cpu VS fickling

  A Python pickling decompiler and static analyzer

  

• llama-int8

  6 1,044 3.6 Python llama-cpu VS llama-int8

  Quantized inference code for LLaMA models

• llama-mps

  4 83 3.8 Python llama-cpu VS llama-mps

  Experimental fork of Facebooks LLaMa model which runs it with GPU acceleration on Apple Silicon M1/M2

• llama

  3 35 1.6 llama-cpu VS llama

  Inference code for LLaMA models (by gmorenz)

• safer_unpickle

  1 5 10.0 Python llama-cpu VS safer_unpickle

• text-g

  1 - - llama-cpu VS text-g

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives