Rust llama

Open-source Rust projects categorized as llama
Edit details
Topics: llm Rust chatgpt openai AI
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 5 Rust llama Projects

  • aichat

    All-in-one AI-Powered CLI Chat & Copilot that integrates 10+ AI platforms, including OpenAI, Azure-OpenAI, Gemini, VertexAI, Claude, Mistral, Cohere, Ollama, Ernie, Qianwen...

    • Project mention: Show HN: A shell CLI tool to predict your next command enhanced by LLM and RAG | news.ycombinator.com | 2024-04-16

    thanks for sharing this, I have been using aichat (https://github.com/sigoden/aichat) and shell_gpt for a while. Let's see how it works.

  • llm-chain

    `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks

    • Project mention: are there anytools or frameworks similar to "langchain" or "llamaindexbut implemented or designed in a language other than python? | /r/LocalLLaMA | 2023-06-28

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • llama-node

    Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

    • Project mention: Tell HN: Rust Is the Superglue | news.ycombinator.com | 2023-07-15

    You can practice your Rust skills by writing performant and/or gluey extensions for higher-level language such as NodeJS (checkout napi-rs) and Python or complementing JS in the browser if you target Webassembly.

    For instance, checkout Llama-node https://github.com/Atome-FE/llama-node for an involved Rust-based NodeJS extension. Python has PyO3, a Rust-Python extension toolset: https://github.com/PyO3/pyo3.

    They can help you leverage your Rust for writing cool new stuff.

  • fltr

    Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.

    • Project mention: Show HN: Like grep but for natural questions. Mixtral 8x7B – 28 tok/s on 8GB GPU | news.ycombinator.com | 2024-03-13

  • llama-dfdx

    LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!

    • Project mention: rustformers/llm: Run inference for Large Language Models on CPU, with Rust 🦀🚀🦙 | /r/rust | 2023-05-10

    Not a maintainer, but dfdx can run llama with CUDA!

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust llama related posts

  • Embeddings are a good starting point for the AI curious app developer

    7 projects | news.ycombinator.com | 17 Apr 2024

  • Show HN: Like grep but for natural questions. Mixtral 8x7B – 28 tok/s on 8GB GPU

    1 project | news.ycombinator.com | 13 Mar 2024

  • Like grep but for natural language questions. Based on Mixtral 8x7B

    1 project | news.ycombinator.com | 5 Mar 2024

  • are there anytools or frameworks similar to "langchain" or "llamaindexbut implemented or designed in a language other than python?

    3 projects | /r/LocalLLaMA | 28 Jun 2023

  • We’re back and…

    5 projects | /r/selfhosted | 18 Jun 2023

  • llm-chain: Rust crate for building LLM chains

    1 project | news.ycombinator.com | 5 Jun 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 9 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source llama projects in Rust? This list will help you:

Project Stars
1 aichat 2,871
2 llm-chain 1,170
3 llama-node 849
4 fltr 340
5 llama-dfdx 94

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com