Rust bindings for the C++ api of PyTorch.
This depends greatly on the kind of model you're talking about. For example, for pytorch, you can use the tch-rs package to load up a model you've saved. I do this; it's a little awkward because of the way the build manages the bindings to the torch library, but it works. But there are many many kinds of model, and the specific thing you're trying to accomplish is going to dominate this discussion. Perhaps you can clarify more what you're hoping to accomplish?
Open deep learning compiler stack for cpu, gpu and specialized accelerators
(2) You could use TVM as your executor instead of tch-rs: https://github.com/apache/tvm/tree/main/rust/tvm
Free Global Payroll designed for tech teams. Building a great tech team takes more than a paycheck. Zero payroll costs, get AI-driven insights to retain best talent, and delight them with amazing local benefits. 100% free and compliant.
Rust language bindings for TensorFlow (by tensorflow)
(3) You could use TensorFlow as your executor: https://github.com/tensorflow/rust
Llama2.rs: One-file Rust implementation of Llama2
3 projects | news.ycombinator.com | 5 Aug 2023
llm: a Rust crate/CLI for CPU inference of LLMs, including LLaMA, GPT-NeoX, GPT-J and more
7 projects | /r/rust | 9 May 2023
Simply explained: How does GPT work?
1 project | news.ycombinator.com | 6 Apr 2023
Will I ever need python again if I learn rust other than for AI stuff?
1 project | /r/Python | 4 Feb 2023
[D] HuggingFace in Julia or Rust ?
3 projects | /r/MachineLearning | 11 Jan 2023