Announcing dfdx - an deep learning library built with const generics

• dfdx

  22 1,617 8.7 Rust

  Deep learning in Rust, with shape checked tensors and neural networks

In dfdx backprop, there's no fixed set of operations, and operation is just a Box> https://github.com/coreylowman/dfdx/blob/main/src/gradients.rs#L37. dfdx backprop used to be similar with the enum for operation types, but supporting batching with that is really hard. Now every tensor operation in dfdx defines the backward op as a closure in the function itself. That also means every operation's backward op can be optimized specifically for that function.

• gamma

  8 381 0.0 Rust

  Computational graphs with reverse automatic differentation in the GPU

There's other differences in how nn layers are implemented if you compare the source of linear layers: https://github.com/coreylowman/dfdx/blob/main/src/nn/linear.rs vs https://github.com/c0dearm/mushin/blob/main/src/nn/layers/linear.rs

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• condor

  1 1 0.0 Rust

  Discontinued Condor is an ergonomic wrapper around the tch library for Rust.

  

Incredible work! I’ve messed around with making DL libraries in rust for my startup. https://github.com/Sidekick-AI/condor is my most recent attempt, which basically wraps tch for speed and provides const generic support. It’s really early and not super robust, so I’m excited to see other efforts in this area.

• dataflow

  2 17 5.6 Rust

  Dataflow is a data processing library, primarily for machine learning. (by jafioti)

  

I’ve made a library for just that: https://github.com/Sidekick-AI/dataflow

Suggest a related project