Would you use maturin for ML model serving?

This page summarizes the projects mentioned and recommended in the original post on /r/rust
Python pyo3 Machine Learning Deep Learning Wheels

InfluxDB
Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • maturin

    Build and publish crates with pyo3, cffi and uniffi bindings as well as rust binaries as python packages

    Maturin looks like a solid project. It seems like a good fit for wrapping up the unsafe Python model in a safe performant Rust HTTP server, or otherwise integrating it with Rust backend code.

  • serving

    A flexible, high-performance serving system for machine learning models

    Which ML framework do you use? Tensorflow has https://github.com/tensorflow/serving. You could also use the Rust bindings to load a saved model and expose it using one of the Rust HTTP servers. It doesn't matter whether you trained your model in Python as long as you export its saved model.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts