Rust AI

Open-source Rust projects categorized as AI

Top 23 Rust AI Projects

  • ChatGPT

    đź”® ChatGPT Desktop Application (Mac, Windows and Linux)

  • Project mention: What AI assistants are already bundled for Linux? | news.ycombinator.com | 2024-03-01

    > I wouldn't hold my breath waiting for a native Linux AI-assisted assistant.

    On Mac when I press Command + Space, it brings up Spotlight search

    That can't easily be added to be the equivalent of some kind of LLM prompt on GNOME/KDE/XFCE?

    I don't quite know what you'd ask it/do with it that would be of much value? Seems like a quicker way/a wrapper around either asking an LLM questions via CLI or basically Electron wrapping HTML (like this https://github.com/lencx/ChatGPT)?

  • tabby

    Self-hosted AI coding assistant

  • Project mention: 17 Best Developer Productivity Tools to Try | dev.to | 2024-05-10

    Two other tools emerging in this category are SuperMaven and TabbyML, both use fast and secure LLM for code completion and recommendations.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • llm

    An ecosystem of Rust libraries for working with large language models

  • Project mention: Open-sourcing a simple automation/agent workflow builder | /r/ChatGPTPro | 2023-10-07

    We're open-sourcing a project that lets you build simple automations/agent workflows that use LLMs for different tasks. Kinda like Zapier or IFTTT but focused on using natural language to accomplish your tasks.It's super early but we'd love to start getting feedback to steer it in the right direction. It currently supports OpenAI and local models through llm.

  • postgresml

    The GPU-powered AI application database. Get your app to market faster using the simplicity of SQL and the latest NLP, ML + LLM models.

  • Project mention: PostgresML | /r/programming | 2023-08-30
  • aichat

    All-in-one AI-Powered CLI Chat & Copilot that integrates 10+ AI platforms, including OpenAI, Azure-OpenAI, Gemini, VertexAI, Claude, Mistral, Cohere, Ollama, Ernie, Qianwen...

  • Project mention: Show HN: A shell CLI tool to predict your next command enhanced by LLM and RAG | news.ycombinator.com | 2024-04-16

    thanks for sharing this, I have been using aichat (https://github.com/sigoden/aichat) and shell_gpt for a while. Let's see how it works.

  • text-embeddings-inference

    A blazing fast inference solution for text embeddings models

  • Project mention: HuggingFace text-generation-inference is reverting to Apache 2.0 License | news.ycombinator.com | 2024-04-08

    Worth noting that this also impacts the great https://github.com/huggingface/text-embeddings-inference, which allows anyone to run state of the art embeddings with great performance.

  • chat-ai-desktop

    Unofficial ChatGPT desktop app for Mac & Windows menubar using Tauri & Rust

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • aici

    AICI: Prompts as (Wasm) Programs

  • Project mention: HonoJS: Small, simple, and ultrafast web framework for the Edges | news.ycombinator.com | 2024-04-15

    Have you looked at AICI by Microsoft yet?

    https://github.com/microsoft/aici/

  • smartgpt

    A program that provides LLMs with the ability to complete complex tasks using plugins.

  • Project mention: Smartgpt: A program that provides LLMs ability with complex tasks using plugins | news.ycombinator.com | 2023-08-28
  • chidori

    A reactive runtime for building durable AI agents

  • Project mention: Chidori – Declarative Framework for AI Agents (Rust, Python, and Node.js) | news.ycombinator.com | 2023-07-26
  • floneum

    A toolkit for controllable, private AI on consumer hardware in rust

  • Project mention: Dioxus 0.5: Web, Desktop, Mobile Apps in Rust | news.ycombinator.com | 2024-03-28

    It is pretty good. I am working on an application that uses SVGs as a way to draw a workflow editor UI with Dioxus: https://github.com/floneum/floneum

  • whatlang-rs

    Natural language detection library for Rust. Try demo online: https://whatlang.org/

  • Project mention: Lingua 1.5.0 - The most accurate natural language detection library for Rust, now with support for detecting multiple languages in mixed-language text | /r/rust | 2023-06-15

    How does it compare to whatlang?

  • llama-node

    Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

  • Project mention: Tell HN: Rust Is the Superglue | news.ycombinator.com | 2023-07-15

    You can practice your Rust skills by writing performant and/or gluey extensions for higher-level language such as NodeJS (checkout napi-rs) and Python or complementing JS in the browser if you target Webassembly.

    For instance, checkout Llama-node https://github.com/Atome-FE/llama-node for an involved Rust-based NodeJS extension. Python has PyO3, a Rust-Python extension toolset: https://github.com/PyO3/pyo3.

    They can help you leverage your Rust for writing cool new stuff.

  • ezkl

    ezkl is an engine for doing inference for deep learning models and other computational graphs in a zk-snark (ZKML). Use it from Python, Javascript, or the command line.

  • Project mention: Show HN: Turn ML/AI models into zero-knowledge proofs | news.ycombinator.com | 2023-10-14
  • ort

    A Rust wrapper for ONNX Runtime (by pykeio)

  • Project mention: AI Inference now available in Supabase Edge Functions | dev.to | 2024-04-16

    To solve this, we built a native extension in Edge Runtime that enables using ONNX runtime via the Rust interface. This was made possible thanks to an excellent Rust wrapper called Ort:

  • blindai

    Confidential AI deployment with secure enclaves :lock:

  • chess-engine

    A dependency-free chess engine♟️ library built to run anywhere.

  • ai00_server

    A localized open-source AI server that is better than ChatGPT.

  • Project mention: People who've used RWKV, whats your wishlist for it? | /r/LocalLLaMA | 2023-12-09
  • Pleco

    A Rust-based re-write of the Stockfish Chess Engine (by pleco-rs)

  • Project mention: I have years of experience in vulnerability analysis including several 0-day discovery, and this bug [buffer overflow] seems totally safe. | /r/programmingcirclejerk | 2023-05-09

    /rj https://github.com/pleco-rs/Pleco

  • LangHelper

    Striving to create a great Application with full functions of learning languages by ChatGPT, TTS, STT and other awesome AI models, supports talking, speaking assessment, memorizing words with contexts, Listening test, so on.

  • bonsai

    Rust implementation of AI behavior trees. (by Sollimann)

  • Project mention: Suggestions for Async Behavior Tree Implementation | /r/rust | 2023-08-18

    Was looking at existing StateMachine and BehaviorTree examples recently and I found the following Behavior Tree crates https://github.com/PistonDevelopers/ai_behavior https://github.com/Sollimann/bonsai

  • asteroids-genetic

    Interactive AI training simuation

  • L2

    l2 is a fast, Pytorch-style Tensor+Autograd library written in Rust

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust AI related posts

  • Show HN: A shell CLI tool to predict your next command enhanced by LLM and RAG

    3 projects | news.ycombinator.com | 16 Apr 2024
  • AI Inference Now Available in Supabase Edge Functions

    1 project | news.ycombinator.com | 16 Apr 2024
  • Dioxus 0.5: Web, Desktop, Mobile Apps in Rust

    5 projects | news.ycombinator.com | 28 Mar 2024
  • Show HN: Kalosm an embeddable framework for pre-trained models in Rust

    3 projects | news.ycombinator.com | 28 Feb 2024
  • Show HN: Mistral LLM w Assistants API and Action tool 4 autonomous requests

    1 project | news.ycombinator.com | 13 Feb 2024
  • Show HN: Tabby back end in 20 Python lines (self-hosted AI coding assistant)

    2 projects | news.ycombinator.com | 29 Jan 2024
  • Aichat: Use GPT-4(V), Gemini, LocalAI, Ollama and Other LLMs in the Terminal

    1 project | news.ycombinator.com | 26 Dec 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 10 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source AI projects in Rust? This list will help you:

Project Stars
1 ChatGPT 47,295
2 tabby 17,420
3 llm 5,931
4 postgresml 5,468
5 aichat 2,871
6 text-embeddings-inference 2,024
7 chat-ai-desktop 1,957
8 aici 1,743
9 smartgpt 1,729
10 chidori 1,197
11 floneum 979
12 whatlang-rs 952
13 llama-node 849
14 ezkl 840
15 ort 580
16 blindai 490
17 chess-engine 397
18 ai00_server 386
19 Pleco 349
20 LangHelper 309
21 bonsai 262
22 asteroids-genetic 221
23 L2 184

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com