llama-dfdx

LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed! (by chelsea0x3b)
Review Cuda Deep Learning Inference language-model llama neural-network Rust rust-lang
Source Code
llama-dfdx Reviews
Suggest alternative
Edit details
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Llama-dfdx Alternatives

Similar projects and alternatives to llama-dfdx

chelsea0x3b
llama-dfdx

  1. textgen

    888 llama-dfdx VS textgen

    Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  3. mlc-llm

    90 llama-dfdx VS mlc-llm

    Universal LLM Deployment Engine with ML Compilation

  4. web-llm

    64 llama-dfdx VS web-llm

    High-performance In-browser LLM Inference Engine

  5. dalai

    59 llama-dfdx VS dalai

    The simplest way to run LLaMA on your local machine

  6. llm

    41 llama-dfdx VS llm

    Discontinued [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models (by rustformers)

  7. peft

    29 llama-dfdx VS peft

    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

  8. RedPajama-Data

    19 llama-dfdx VS RedPajama-Data

    The RedPajama-Data repository contains code for preparing large datasets for training large language models.

  9. wonnx

    18 llama-dfdx VS wonnx

    Discontinued A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web

  10. fastllm

    1 llama-dfdx VS fastllm

    Discontinued FastLLM - Blazingly Fast Rust based LLM Inference API [GET https://api.github.com/repos/lukehinds/fastllm: 404 - Not Found // See: https://docs.github.com/rest] (by lukehinds)

  11. LLaMA_MPS

    4 llama-dfdx VS LLaMA_MPS

    Discontinued Run LLaMA inference on Apple Silicon GPUs.

  12. llm

    102 llama-dfdx VS llm

    Access large language models from the command-line

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better llama-dfdx alternative or higher similarity.
Suggest an alternative to llama-dfdx

llama-dfdx discussion

Log in or Post with

llama-dfdx reviews and mentions

Posts with mentions or reviews of llama-dfdx. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-05-10.

Stats

Basic llama-dfdx repo stats
2
113
7.3
about 3 years ago

chelsea0x3b/llama-dfdx is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of llama-dfdx is Rust.

Popular Comparisons

  1. llama-dfdx VS llm
  2. llama-dfdx VS fastllm
  3. llama-dfdx VS RedPajama-Data
  4. llama-dfdx VS wonnx
  5. llama-dfdx VS textgen
  6. llama-dfdx VS peft
  7. llama-dfdx VS dalai
  8. llama-dfdx VS LLaMA_MPS
  9. llama-dfdx VS llm
  10. llama-dfdx VS web-llm

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Loading...