Differentiable Programming from Scratch

• nx

  36 2,487 9.3 Elixir

  Multi-dimensional arrays (tensors) and numerical definitions for Elixir (by elixir-nx)

  

Thank you for sharing, this was a great article!

I had to implement autodiff from scratch for Nx (https://github.com/elixir-nx/nx) about 18 months ago and this would have helped me so much! I spent roughly a month chasing a bug because I was not handling the case of duplicated incoming nodes and you outline it very clearly. I will be recommending the article from now on to anyone who needs to understand how autodiff works. :)

• Dual-numbers-and-automatic-differentiation-using-Python

  2 17 10.0 Jupyter Notebook

  Implemented the forward mode of automatic differentiation with the help of dual numbers using Python.

The estimate for the derivative is 0 here, which is wrong. The finite differencing cannot be improved using stencil theory. Dual numbers win.

[1] - https://github.com/ujjwalkhandelwal/Dual-numbers-and-automat...

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Dual-numbers-and-automat

  1 - -

The estimate for the derivative is 0 here, which is wrong. The finite differencing cannot be improved using stencil theory. Dual numbers win.

[1] - https://github.com/ujjwalkhandelwal/Dual-numbers-and-automat...

Suggest a related project