Rust Machine Learning

Open-source Rust projects categorized as Machine Learning

Top 23 Rust Machine Learning Projects

Machine Learning
  • qdrant

    Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

  • Project mention: WizSearch: 🏆 Winning My First AI Hackathon 🚀 | dev.to | 2024-06-10

    Vector Databases: Qdrant for efficient data storage and retrieval.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • burn

    Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

  • Project mention: 3 years of fulltime Rust game development, and why we're leaving Rust behind | news.ycombinator.com | 2024-04-26

    You can use libtorch directly via `tch-rs`, and at present I'm porting over to Burn (see https://burn.dev) which appears incredibly promising. My impression is it's in a good place, if of course not close to the ecosystem of Python/C++. At very least I've gotten my nn models training and running without too much difficulty. (I'm moving to Burn for the thread safety - their `Tensor` impl is `Sync` - libtorch doesn't have such a guarantee.)

    Burn has Candle as one of its backends, which I understand is also quite popular.

  • postgresml

    The GPU-powered AI application database. Get your app to market faster using the simplicity of SQL and the latest NLP, ML + LLM models.

  • Project mention: PostgresML | /r/programming | 2023-08-30
  • leaf

    Open Machine Intelligence Framework for Hackers. (GPU/CPU)

  • rust

    Rust language bindings for TensorFlow (by tensorflow)

  • tch-rs

    Rust bindings for the C++ api of PyTorch.

  • Project mention: Tch-Rs | news.ycombinator.com | 2023-12-07
  • linfa

    A Rust machine learning framework.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • lance

    Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

  • Project mention: The Nimble File Format by Meta | news.ycombinator.com | 2024-04-25
  • hora

    🚀 efficient approximate nearest neighbor search algorithm collections library written in Rust 🦀 .

  • rust-bert

    Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

  • Daft

    Distributed DataFrame for Python designed for the cloud, powered by Rust

  • Project mention: Pg_lakehouse: Query Any Data Lake from Postgres | news.ycombinator.com | 2024-05-13

    We're actually using pyiceberg to retrieve metadata! All our IO and decoding happens in the rust side once the data has been passthrough.

    We expose something called a ScanOperator which allows integration into various catalogs through a thin layer that exposes ScanTasks.

    Iceberg's impl: https://github.com/Eventual-Inc/Daft/blob/416009138359a9d410...

  • dfdx

    Deep learning in Rust, with shape checked tensors and neural networks

  • Project mention: Shape Typing in Python | news.ycombinator.com | 2024-04-13
  • spiceai

    A unified SQL query interface and portable runtime to locally materialize, accelerate, and query datasets from any database, data warehouse, or data lake.

  • Project mention: Show HN: Spice.ai – materialize, accelerate, and query SQL data from any source | news.ycombinator.com | 2024-03-28

    Yes, it's on the backlog and we'll prioritize as we see demand as with https://github.com/spiceai/spiceai/issues/999.

  • juice

    The Hacker's Machine Learning Engine (by fff-rs)

  • ocrs

    Rust library and CLI tool for OCR (extracting text from images)

  • Project mention: Ocrs: Rust library and CLI tool for extracting text from images | news.ycombinator.com | 2024-03-31
  • RustQuant

    Rust library for quantitative finance.

  • Project mention: RustQuant: A Library for Quantitative Finance | news.ycombinator.com | 2024-02-01
  • motorhead

    🧠 Motorhead is a memory and information retrieval server for LLMs.

  • Project mention: Motorhead is a memory and information retrieval server for LLMs | news.ycombinator.com | 2023-10-22
  • femtoGPT

    Pure Rust implementation of a minimal Generative Pretrained Transformer

  • Project mention: Ask HN: How to get started with local language models? | news.ycombinator.com | 2024-03-17

    If you want to get deep in LLMs: https://github.com/keyvank/femtoGPT

  • pipeless

    An open-source computer vision framework to build and deploy apps in minutes

  • Project mention: Vision AI agents for any task | dev.to | 2024-04-30

    After spending some months working on the Pipeless open-source framework, today I bring something new and really cool: Pipeless Agents

  • smartcore

    A comprehensive library for machine learning and numerical computing. The library provides a set of tools for linear algebra, numerical computing, optimization, and enables a generic, powerful yet still efficient approach to machine learning.

  • ort

    A Rust wrapper for ONNX Runtime (by pykeio)

  • Project mention: AI Inference now available in Supabase Edge Functions | dev.to | 2024-04-16

    To solve this, we built a native extension in Edge Runtime that enables using ONNX runtime via the Rust interface. This was made possible thanks to an excellent Rust wrapper called Ort:

  • rustlearn

    Machine learning crate for Rust

  • Nuclia DB

    NucliaDB, The AI Search database for RAG

  • Project mention: Tantivy 0.20 is released: Schemaless column store, Schemaless aggregations, Phrase prefix queries, Percentiles, and more... | /r/rust | 2023-06-20

    You have also NucliaDB that is built on top of tantivy and addresses vector search for documents and video search.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust Machine Learning discussion

Log in or Post with

Rust Machine Learning related posts

  • Show HN: Open-Source Distributed Data Framework for LLM Applications

    1 project | news.ycombinator.com | 23 May 2024
  • How I got my first Rust job by doing open-source

    3 projects | dev.to | 30 Apr 2024
  • The Nimble File Format by Meta

    2 projects | news.ycombinator.com | 25 Apr 2024
  • Burn: Deep Learning Framework built using Rust

    1 project | news.ycombinator.com | 24 Apr 2024
  • AI Inference Now Available in Supabase Edge Functions

    1 project | news.ycombinator.com | 16 Apr 2024
  • Ocrs: Rust library and CLI tool for extracting text from images

    1 project | news.ycombinator.com | 31 Mar 2024
  • Indexify -Scalable, realtime, continuous indexing engine–Unstructured Data to AI

    1 project | news.ycombinator.com | 6 Mar 2024
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 14 Jun 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source Machine Learning projects in Rust? This list will help you:

Project Stars
1 qdrant 18,501
2 burn 7,526
3 postgresml 5,615
4 leaf 5,554
5 rust 5,065
6 tch-rs 3,957
7 linfa 3,481
8 lance 3,449
9 hora 2,560
10 rust-bert 2,464
11 Daft 1,808
12 dfdx 1,656
13 spiceai 1,562
14 juice 1,095
15 ocrs 966
16 RustQuant 913
17 motorhead 835
18 femtoGPT 762
19 pipeless 669
20 smartcore 662
21 ort 654
22 rustlearn 611
23 Nuclia DB 590

Sponsored
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com