llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models (by rustformers)
Review AI ggml LLM ML Rust

DISCONTINUED

Suggest alternative
Edit details
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Llm Alternatives

Similar projects and alternatives to llm

rustformers
llm

  1. llama.cpp

    1,032 llm VS llama.cpp

    LLM inference in C/C++

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  3. textgen

    887 llm VS textgen

    Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

  4. crates.io

    686 llm VS crates.io

    The Rust package registry

  5. dioxus

    191 llm VS dioxus

    Fullstack app framework for web, desktop, and mobile.

  6. llama

    190 llm VS llama

    Inference code for Llama models

  7. alpaca-lora

    107 llm VS alpaca-lora

    Instruct-tune LLaMA on consumer hardware

  8. alpaca.cpp

    94 llm VS alpaca.cpp

    Discontinued Locally run an Instruction-Tuned Chat-Style LLM

  9. ggml

    76 llm VS ggml

    Tensor library for machine learning

  10. lora

    83 llm VS lora

    Using Low-rank adaptation to quickly fine-tune diffusion models. (by cloneofsimo)

  11. GPTQ-for-LLaMa

    75 llm VS GPTQ-for-LLaMa

    4 bits quantization of LLaMA using GPTQ

  12. wonnx

    18 llm VS wonnx

    Discontinued A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web

  13. rwkv.cpp

    13 llm VS rwkv.cpp

    INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

  14. diffusers-rs

    4 llm VS diffusers-rs

    An implementation of the diffusers api in Rust

  15. character-editor

    50 llm VS character-editor

    Discontinued Create, edit and convert AI character files for CharacterAI, Pygmalion, Text Generation, KoboldAI and TavernAI [GET https://api.github.com/repos/ZoltanAI/character-editor: 404 - Not Found // See: https://docs.github.com/rest]

  16. PaLM

    7 llm VS PaLM

    Discontinued An open-source implementation of Google's PaLM models

  17. cformers

    4 llm VS cformers

    SoTA Transformers with C-backend for fast inference on your CPU.

  18. rllama

    7 llm VS rllama

    Rust+OpenCL+AVX2 implementation of LLaMA inference code

  19. llm-foundry

    38 llm VS llm-foundry

    LLM training code for Databricks foundation models

  20. pyllama

    5 llm VS pyllama

    LLaMA: Open and Efficient Foundation Language Models

  21. secondbrain

    3 llm VS secondbrain

    Multi-platform desktop app to download and run Large Language Models(LLM) locally in your computer.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better llm alternative or higher similarity.
Suggest an alternative to llm

llm discussion

Log in or Post with

llm reviews and mentions

Posts with mentions or reviews of llm. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-10-07.

Stats

Basic llm repo stats
41
6,044
9.4
almost 2 years ago

rustformers/llm is an open source project licensed under Apache License 2.0 which is an OSI approved license.

The primary programming language of llm is Rust.

Popular Comparisons

  1. llm VS ggml
  2. llm VS character-editor
  3. llm VS PaLM
  4. llm VS diffusers-rs
  5. llm VS llm-foundry
  6. llm VS llama.cpp
  7. llm VS cformers
  8. llm VS llama-dfdx
  9. llm VS SD-CN-Animation
  10. llm VS wonnx

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com

Did you know that Rust is
the 3rd most popular programming language
based on number of references?

Loading...