Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today. Learn more →
Top 23 Rust Machine Learning Projects
Qdrant - Vector Database for the next generation of AI applications. Also available in the cloud https://cloud.qdrant.io/Project mention: Open source vector databases? | /r/ChatGPTCoding | 2023-06-04
There are plenty of options, but I'd suggest Qdrant on Docker: https://qdrant.tech/
Open Machine Intelligence Framework for Hackers. (GPU/CPU)
Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.
Rust language bindings for TensorFlow (by tensorflow)Project mention: Have you ever wanted a library to check for 69 in a string? | /r/rustjerk | 2023-04-20
You can use Tensorflow for Rust to simplify that task and avoid pain with regex. Just have the right mindset.
PostgresML is an AI application database. Download open source models from Huggingface, or train your own, to create and index LLM embeddings, generate text, or make online predictions using only SQL.Project mention: Python SDK for PostgresML with scalable LLM embedding memory and text generation | news.ycombinator.com | 2023-06-02
We've been working on a Python SDK for PostgresML to make it easier for application developers to get the performance and scalability benefits of integrated memory for LLMs, by combining embedding generation, vector recall and LLM tasks from HuggingFace in a single database query.
This work builds on our previous efforts that give a 10x performance improvement from generating the LLM embedding from input text along with tuning vector recall in a single process to avoid excessive network transit.
We'd love your feedback on our roadmap for this extension, if you have other use cases for an ML application database. So far, we've implemented our best practices for scalable vector storage to provide an example reference implementation for interacting with an ML application database based on Postgres.
Rust bindings for the C++ api of PyTorch.Project mention: llm: a Rust crate/CLI for CPU inference of LLMs, including LLaMA, GPT-NeoX, GPT-J and more | /r/rust | 2023-05-09
You could try looking at the min-GPT example of tch-rs. I'd also strongly suggest watching Karpathy's video to understand what's going on.
A Rust machine learning framework.Project mention: Why is Rust not more popular in ML and secure edge computing? | /r/rust | 2022-11-13
🚀 efficient approximate nearest neighbor search algorithm collections library written in Rust 🦀 .Project mention: Building a Vector Database with Rust to Make Use of Vector Embeddings | /r/rust | 2023-06-01
We have been playing around with Hora as a replacement for the Rust-CV implementation as we want PQ as well. I'll check out instanct-distance, looks very interesting!
Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
Burn - A Flexible and Comprehensive Deep Learning Framework in RustProject mention: I’ve fallen in love with rust so now what? | /r/rust | 2023-05-21
Here is the project: https://github.com/burn-rs/burn
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)Project mention: Transformers.js | news.ycombinator.com | 2023-03-16
I'd like to use this transformer model in rust (because it's on the backend, because I can use data munging and it will be faster, and for other reasons). It looks like a good model! But, it doesn't compile on Apple Silicon for wierd linking issues that aren't apparent - https://github.com/guillaume-be/rust-bert/issues/338. I've spent a large part of today and yesterday attempting to find out why. The only other library that I've found for doing this kind of thing programmatically (particularly sentiment analysis) is this (https://github.com/JohnSnowLabs/spark-nlp). Some of the models look a little older, which is OK, but it does mean that I'd have to do this in another language.
Does anyone know of any sentiment analysis software that can be tuned (other than VADER - I'm looking for more along the lines of a transformer model) - like BERT, but is pretrained and can be used in Rust or Python? Otherwise I'll probably using spark-nlp and having to spin another process.
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..Project mention: FLaNK Stack 5-June-2023 | dev.to | 2023-06-05
Deep learning in Rust, with shape checked tensors and neural networksProject mention: Are there some machine or deep learning crates on Rust? | /r/rust | 2023-04-29
The Hacker's Machine Learning Engine (by spearow)Project mention: Juice: The Hacker's Machine Learning Engine | news.ycombinator.com | 2022-07-11
Machine learning crate for Rust
🧠 Motorhead is a memory and information retrieval server for LLMs.Project mention: Any Alternatives to Langchain? | /r/aipromptprogramming | 2023-05-16
Any alternatives? I found this Rust based project that might be interesting: https://github.com/getmetal/motorhead
A comprehensive library for machine learning and numerical computing. The library provides a set of tools for linear algebra, numerical computing, optimization, and enables a generic, powerful yet still efficient approach to machine learning.Project mention: ML in Rust: smartcore | dev.to | 2022-11-09
Today we have released version 0.3 of smartcore: a comprehensive library for machine learning and numerical computing. The library provides a set of tools for linear algebra, numerical computing, optimization, and enables a generic, powerful yet still efficient approach to machine learning.
A fast, low-resource Natural Language Processing and Text Correction library written in Rust.Project mention: Language Tool – open-source Grammarly Alternative | news.ycombinator.com | 2022-07-26
check out nlprule, it's LanguageTool alternative written in Rust
Python Stream ProcessingProject mention: Stream processing framework for a new project in Python | /r/dataengineering | 2023-06-02
Disclaimer: I work on Bytewax, but it feels like this could be a good fit and would save you some time looking around. If you need to do stateful operations (reduce, window, etc.) then you can use bytewax - https://github.com/bytewax/bytewax with pub/sub, but you would need to build a custom connector. There are some guides on how to do that - https://www.bytewax.io/blog/custom-input-connector.
Confidential AI deployment with secure enclaves :lock:Project mention: [D] Any options for using GPT models using proprietary data ? | /r/MachineLearning | 2023-04-02
We are working on an open-source project, BlindAI (https://github.com/mithril-security/blindai) to answer exactly that: privacy when sending data to remote AI models.
Computational graphs with reverse automatic differentation in the GPUProject mention: Announcing dfdx - an deep learning library built with const generics | /r/rust | 2022-07-13
There's other differences in how nn layers are implemented if you compare the source of linear layers: https://github.com/coreylowman/dfdx/blob/main/src/nn/linear.rs vs https://github.com/c0dearm/mushin/blob/main/src/nn/layers/linear.rs
High performance distributed framework for training deep learning recommendation models based on PyTorch.
How ready is Rust for Machine Learning?Project mention: This year I tried solving AoC using Rust, here are my impressions coming from Python! | /r/rust | 2023-01-02
NucliaDB, The vector database optimized for documents and video searchProject mention: Alternatives to Pinecone? (Vector databases) [D] | /r/MachineLearning | 2023-04-14
Machine Learning Library for Rust
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Rust Machine Learning related posts
Python SDK for PostgresML with scalable LLM embedding memory and text generation
1 project | news.ycombinator.com | 2 Jun 2023
[P] Python SDK for PostgresML w/ scalable LLM embedding memory and text generation
1 project | /r/MachineLearning | 2 Jun 2023
[Show HN] Lance is a Rust-based alternative to Parquet for ML data
1 project | /r/hypeurls | 31 May 2023
Show HN: Lance is a Rust-based alternative to Parquet for ML data
4 projects | news.ycombinator.com | 31 May 2023
dna_parser : A Python package written in Rust to encode DNA sequences for machine learning.
2 projects | /r/rust | 17 May 2023
Any Alternatives to Langchain?
1 project | /r/aipromptprogramming | 16 May 2023
Show HN: We unified LLMs, vector memory, ranking, pruning models in one process
2 projects | news.ycombinator.com | 12 May 2023
A note from our sponsor - SonarLint
www.sonarlint.org | 6 Jun 2023
What are some of the best open-source Machine Learning projects in Rust? This list will help you: