Rust Bert

Open-source Rust projects categorized as Bert
Topics: NLP Gpt Rust Search ML

Top 4 Rust Bert Projects

  • tokenizers

    💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

  • Project mention: HF Transfer: Speed up file transfers | /r/rust | 2023-07-07

    Hugging Face seems to like Rust. They also wrote Tokenizers in Rust.

  • rust-bert

    Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

  • Project mention: How to leverage the state-of-the-art NLP models in Rust | /r/infinilabs | 2023-06-07

    brew install libtorch brew link libtorch brew ls --verbose libtorch | grep dylib export LIBTORCH=$(brew --cellar pytorch)/$(brew info --json pytorch | jq -r '.[0].installed[0].version') export LD_LIBRARY_PATH=${LIBTORCH}/lib:$LD_LIBRARY_PATH git clone https://github.com/guillaume-be/rust-bert.git cd rust-bert ORT_STRATEGY=system cargo run --example sentence_embeddings

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • syntaxdot

    Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.

  • Project mention: Candle: Torch Replacement in Rust | news.ycombinator.com | 2023-08-08

    I am so happy about them releasing this. A few years ago I wrote a multi-task syntax annotator in Rust using Laurent Mazare's excellent tch-rs binding (it seems like he is also working on Candle):

    https://github.com/tensordot/syntaxdot

    However, the deployment story was always quite difficult. The PyTorch C++ API is not stable, so a particular version of tch-rs will only work with a particular PyTorch version. So, anyone wanting to use SyntaxDot always had to get exactly the right version of libtorch (and set some environment variables) to build the project.

    The idea of making an abstraction over Torch and Rust ndarray (similar to Burn) crossed my mind several times, but there is only so much that I could do as a solo developer. So Candle would be a god-given if I was still working on this project.

    Seeing Candle wants to make me port curated-transformers to Candle for fun:

    https://github.com/explosion/curated-transformers

  • semdesk

    Semantic Desktop Search - search for answers not the file names

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust Bert related posts

  • Creating search engine for your local network - Is it even possible?

    2 projects | /r/selfhosted | 2 Jul 2023
  • Self-hosted Whisper-based voice recognition server for open Android phones

    2 projects | news.ycombinator.com | 13 Feb 2023
  • Ask HN: Has anyone made a toy that integrates ChatGPT with voice into a toy?

    2 projects | news.ycombinator.com | 9 Feb 2023

Index

What are some of the best open-source Bert projects in Rust? This list will help you:

Project Stars
1 tokenizers 8,538
2 rust-bert 2,448
3 syntaxdot 67
4 semdesk 1

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com