Integrating machine learning models into Rust applications?

This page summarizes the projects mentioned and recommended in the original post on /r/rust

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • tch-rs

    Rust bindings for the C++ api of PyTorch.

  • This depends greatly on the kind of model you're talking about. For example, for pytorch, you can use the tch-rs package to load up a model you've saved. I do this; it's a little awkward because of the way the build manages the bindings to the torch library, but it works. But there are many many kinds of model, and the specific thing you're trying to accomplish is going to dominate this discussion. Perhaps you can clarify more what you're hoping to accomplish?

  • tvm

    Open deep learning compiler stack for cpu, gpu and specialized accelerators

  • (2) You could use TVM as your executor instead of tch-rs: https://github.com/apache/tvm/tree/main/rust/tvm

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • rust

    Rust language bindings for TensorFlow (by tensorflow)

  • (3) You could use TensorFlow as your executor: https://github.com/tensorflow/rust

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Tch-Rs

    1 project | news.ycombinator.com | 7 Dec 2023
  • Llama2.rs: One-file Rust implementation of Llama2

    3 projects | news.ycombinator.com | 5 Aug 2023
  • llm: a Rust crate/CLI for CPU inference of LLMs, including LLaMA, GPT-NeoX, GPT-J and more

    7 projects | /r/rust | 9 May 2023
  • Simply explained: How does GPT work?

    1 project | news.ycombinator.com | 6 Apr 2023
  • Will I ever need python again if I learn rust other than for AI stuff?

    1 project | /r/Python | 4 Feb 2023