Rust AI

Open-source Rust projects categorized as AI
Edit details
Topics: #Rust #llm #openai #Machine Learning #gpt-3
Learn any GitHub repo in 59 seconds
Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.
getonboard.dev
Sponsored

Top 23 Rust AI Projects

  • chat-ai-desktop

    Unofficial ChatGPT desktop app for Mac & Windows menubar using Tauri & Rust

    Project mention: Is ChatGPT consistently at capacity, or is this just a way for blocking certain users? | /r/ChatGPT | 2023-01-16

    I have this desktop app and it's giving me the "at capacity" error.

  • aichat

    Use GPT-4(V), LocalAI and other LLMs in the terminal.

    Project mention: Stop wasting time on watching questionable Youtube videos, make ChatGTP do it for you | /r/commandline | 2023-06-02

    Tools required: https://github.com/yt-dlp/yt-dlp https://github.com/sigoden/aichat

  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

  • smartgpt

    A program that provides LLMs with the ability to complete complex tasks using plugins.

    Project mention: Smartgpt: A program that provides LLMs ability with complex tasks using plugins | news.ycombinator.com | 2023-08-28

  • text-embeddings-inference

    A blazing fast inference solution for text embeddings models

    Project mention: FLaNK Stack Weekly for 30 Oct 2023 | dev.to | 2023-10-30

  • chidori

    A reactive runtime for building durable AI agents

    Project mention: Chidori – Declarative Framework for AI Agents (Rust, Python, and Node.js) | news.ycombinator.com | 2023-07-26

  • whatlang-rs

    Natural language detection library for Rust. Try demo online: https://whatlang.org/

    Project mention: Lingua 1.5.0 - The most accurate natural language detection library for Rust, now with support for detecting multiple languages in mixed-language text | /r/rust | 2023-06-15

    How does it compare to whatlang?

  • llama-node

    Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

    Project mention: Tell HN: Rust Is the Superglue | news.ycombinator.com | 2023-07-15

    You can practice your Rust skills by writing performant and/or gluey extensions for higher-level language such as NodeJS (checkout napi-rs) and Python or complementing JS in the browser if you target Webassembly.

    For instance, checkout Llama-node https://github.com/Atome-FE/llama-node for an involved Rust-based NodeJS extension. Python has PyO3, a Rust-Python extension toolset: https://github.com/PyO3/pyo3.

    They can help you leverage your Rust for writing cool new stuff.

  • Onboard AI

    Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.

  • ezkl

    ezkl is an engine for doing inference for deep learning models and other computational graphs in a zk-snark (ZKML). Use it from Python, Javascript, or the command line.

    Project mention: Show HN: Turn ML/AI models into zero-knowledge proofs | news.ycombinator.com | 2023-10-14

  • blindai

    Confidential AI deployment with secure enclaves :lock:

    Project mention: [D] Any options for using GPT models using proprietary data ? | /r/MachineLearning | 2023-04-02

    We are working on an open-source project, BlindAI (https://github.com/mithril-security/blindai) to answer exactly that: privacy when sending data to remote AI models.

  • floneum

    A graph editor for local AI workflows

    Project mention: Announcing Kalosm - an local first AI meta-framework for Rust | /r/rust | 2023-11-12

    Kalosm is a meta-framework for AI written in Rust using candle. Kalosm supports local quantized large language models like Llama, Mistral, Phi-1.5, and Zephyr. It also supports other quantized models like Wuerstchen, Segment Anything, and Whisper. In addition to local models, Kalosm supports remote models like GPT-4 and ada embeddings.

  • chess-engine

    A dependency-free chess engine♟️ library built to run anywhere.

  • ort

    A Rust wrapper for ONNX Runtime (by pykeio)

    Project mention: Moving from Typescript and Langchain to Rust and Loops | dev.to | 2023-09-07

    In the quest for more efficient solutions, the ONNX runtime emerged as a beacon of performance. The decision to transition from Typescript to Rust was an unconventional yet pivotal one. Driven by Rust's robust parallel processing capabilities using Rayon and seamless integration with ONNX through the ort crate, Repo-Query unlocked a realm of unparalleled efficiency. The result? A transformation from sluggish processing to, I have to say it, blazing-fast performance.

  • Pleco

    A Rust-based re-write of the Stockfish Chess Engine (by pleco-rs)

    Project mention: I have years of experience in vulnerability analysis including several 0-day discovery, and this bug [buffer overflow] seems totally safe. | /r/programmingcirclejerk | 2023-05-09

    /rj https://github.com/pleco-rs/Pleco

  • LangHelper

    Striving to create a great Application with full functions of learning languages by ChatGPT, TTS, STT and other awesome AI models, supports talking, speaking assessment, memorizing words with contexts, Listening test, so on.

    Project mention: GitHub - NsLearning/LangHelper: Striving to create a great Applicat...GitHub - NsLearning/LangHelper: Striving to create a great Applicat... | /r/thirdbrain | 2023-04-24

  • ai00_rwkv_server

    A localized open-source AI server that is better than ChatGPT.

    Project mention: People who've used RWKV, whats your wishlist for it? | /r/LocalLLaMA | 2023-12-09

  • bonsai

    Rust implementation of behavior trees. (by Sollimann)

    Project mention: Suggestions for Async Behavior Tree Implementation | /r/rust | 2023-08-18

    Was looking at existing StateMachine and BehaviorTree examples recently and I found the following Behavior Tree crates https://github.com/PistonDevelopers/ai_behavior https://github.com/Sollimann/bonsai

  • L2

    l2 is a fast, Pytorch-style Tensor+Autograd library written in Rust

  • rsrl

    A fast, safe and easy to use reinforcement learning framework in Rust.

  • rust-drive-ai

    Self driving car AI in road fighter world

    Project mention: [Media] Self driving car simulation - Road Fighter AI (code in comments) | /r/rust | 2023-06-11

    Youtube video: https://youtu.be/H7RWcNgE-6s

  • opentau

    Using Large Language Models for Gradual Type Inference

    Project mention: Opentau – Using Large Language Models for Gradual Type Inference | news.ycombinator.com | 2023-08-13

  • gpt-cli

    Run linux commands with natural language. Eg.: "show my graphic card" instead "lspci | grep VGA" (by gustawdaniel)

    Project mention: yay -S gpt-cli && GPT3_API_KEY=sk-xxx p name of linux distro Judd Vinet | /r/archlinux | 2023-03-19

  • simd-alphatensor-rs

    🧮 alphatensor matrix breakthrough algorithms + simd + rust.

  • anansi

    open source tooling for AI search and understanding (by infrawhispers)

    Project mention: DiskANN Implementation in Rust + Easy NN Search | /r/rust | 2023-05-20

    Hi! I have been noodling away at a re-implementation of the original C++ DiskANN project as well as packaging the latest advances in embedding generation. The rough repo is here and will remain licensed as Apache-2.0!

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-12-09.

Rust AI related posts

Index

What are some of the best open-source AI projects in Rust? This list will help you:

Project Stars
1 chat-ai-desktop 1,884
2 aichat 1,751
3 smartgpt 1,683
4 text-embeddings-inference 1,365
5 chidori 1,151
6 whatlang-rs 902
7 llama-node 805
8 ezkl 696
9 blindai 471
10 floneum 455
11 chess-engine 383
12 ort 365
13 Pleco 333
14 LangHelper 292
15 ai00_rwkv_server 241
16 bonsai 222
17 L2 179
18 rsrl 158
19 rust-drive-ai 88
20 opentau 83
21 gpt-cli 63
22 simd-alphatensor-rs 57
23 anansi 44

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com