Rust Embeddings

Open-source Rust projects categorized as Embeddings
Edit details
Topics: Machine Learning AI Python Rust vector-search
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 11 Rust Embedding Projects

  • postgresml

    The GPU-powered AI application database. Get your app to market faster using the simplicity of SQL and the latest NLP, ML + LLM models.

    • Project mention: PostgresML | /r/programming | 2023-08-30

  • paradedb

    Postgres for Search and Analytics

    • Project mention: Using ClickHouse to scale an events engine | news.ycombinator.com | 2024-04-11

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • lance

    Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

    • Project mention: The Nimble File Format by Meta | news.ycombinator.com | 2024-04-25

  • text-embeddings-inference

    A blazing fast inference solution for text embeddings models

    • Project mention: HuggingFace text-generation-inference is reverting to Apache 2.0 License | news.ycombinator.com | 2024-04-08

    Worth noting that this also impacts the great https://github.com/huggingface/text-embeddings-inference, which allows anyone to run state of the art embeddings with great performance.

  • llama-node

    Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

    • Project mention: Tell HN: Rust Is the Superglue | news.ycombinator.com | 2023-07-15

    You can practice your Rust skills by writing performant and/or gluey extensions for higher-level language such as NodeJS (checkout napi-rs) and Python or complementing JS in the browser if you target Webassembly.

    For instance, checkout Llama-node https://github.com/Atome-FE/llama-node for an involved Rust-based NodeJS extension. Python has PyO3, a Rust-Python extension toolset: https://github.com/PyO3/pyo3.

    They can help you leverage your Rust for writing cool new stuff.

  • tinyvector

    A tiny embedding database in pure Rust.

    • Project mention: Tinyvector - a tiny embedding database in pure Rust | /r/aiengineer | 2023-07-11

  • fastembed-rs

    Library to generate vector embeddings. Rust implementation of Qdrant's FastEmbed.

    • Project mention: Embeddings are a good starting point for the AI curious app developer | news.ycombinator.com | 2024-04-17

    Yes, I use fastembed-rs[1] in a project I'm working on and it runs flawlessly. You can store the embeddings in any boring database, but for fast vector math, a vector database is recommended (e.g. the pgvector postgres extension).

    [1] https://github.com/Anush008/fastembed-rs

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • finalfusion-rust

    finalfusion embeddings in Rust

  • anansi

    open source tooling for AI search and understanding (by infrawhispers)

    • Project mention: DiskANN Implementation in Rust + Easy NN Search | /r/rust | 2023-05-20

    Hi! I have been noodling away at a re-implementation of the original C++ DiskANN project as well as packaging the latest advances in embedding generation. The rough repo is here and will remain licensed as Apache-2.0!

  • dpar

    Neural network transition-based dependency parser (in Rust)

  • reductive

    Vector quantization

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust Embeddings related posts

  • Embeddings are a good starting point for the AI curious app developer

    7 projects | news.ycombinator.com | 17 Apr 2024

  • Show HN: Neum AI – Open-source large-scale RAG framework

    3 projects | news.ycombinator.com | 21 Nov 2023

  • Cleora.ai - open source general-purpose model for efficient, scalable learning of stable and inductive entity embeddings for heterogeneous relational data - new updates

    1 project | /r/MachineLearning | 15 Mar 2021

  • Cleora - an ultra fast graph embedding tool written in Rust

    1 project | /r/rust | 12 Feb 2021

  • [R] Cleora: A Simple, Strong and Scalable Graph Embedding Scheme

    2 projects | /r/MachineLearning | 11 Feb 2021

  • [R] Cleora - the fastest graph & hypergraph node embedding tool

    1 project | /r/MachineLearning | 11 Feb 2021
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 10 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source Embedding projects in Rust? This list will help you:

Project Stars
1 postgresml 5,468
2 paradedb 3,962
3 lance 3,296
4 text-embeddings-inference 2,024
5 llama-node 849
6 tinyvector 340
7 fastembed-rs 155
8 finalfusion-rust 86
9 anansi 48
10 dpar 41
11 reductive 6

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com