Top 6 Rust language-model Projects

tokenizers

8 8,395 8.5 Rust

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Project mention: HF Transfer: Speed up file transfers | /r/rust | 2023-07-07

Hugging Face seems to like Rust. They also wrote Tokenizers in Rust.

aici

6 1,714 9.9 Rust

AICI: Prompts as (Wasm) Programs

Project mention: HonoJS: Small, simple, and ultrafast web framework for the Edges | news.ycombinator.com | 2024-04-15

Have you looked at AICI by Microsoft yet?
https://github.com/microsoft/aici/

WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
Nuclia DB

3 571 9.9 Rust

NucliaDB, The AI Search database for RAG

Project mention: Tantivy 0.20 is released: Schemaless column store, Schemaless aggregations, Phrase prefix queries, Percentiles, and more... | /r/rust | 2023-06-20

You have also NucliaDB that is built on top of tantivy and addresses vector search for documents and video search.

rusty

2 322 3.7 Rust

AI-powered CLI tool to help you remember bash commands.
smolrsrwkv

6 91 5.6 Rust

A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit evaluation. It can also directly load PyTorch RWKV models.
bytepiece-rs

1 14 7.4 Rust

The Bytepiece Tokenizer Implemented in Rust.

Project mention: A more general tokenizer | /r/rust | 2023-09-25

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).