[D] Backpropagation is not just the chain-rule, then what is it?

This page summarizes the projects mentioned and recommended in the original post on /r/MachineLearning

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • micrograd

    A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

  • Check out this repo I found a few years back when I was looking into understanding pytorch better. It's basically a super tiny autodiff library that only works on scalars. The whole repo is under 200 lines of code, so you can pull up pycharm or whatever and step through the code and see how it all comes together. Or... you know. Just read it, it's not super complicated.

  • ml-coursera-python-assignments

    Python assignments for the machine learning class by andrew ng on coursera with complete submission for grading capability and re-written instructions.

  • check this out in particular. It's the week 4 homework from Ng's course, redone by someone to be in Python instead of Octave. It's got a built in grader, so you can grab the jupyter notebook, run it locally and it'll tell you when you've got the answer right. I'd recommend taking a crack at it, then when you figure out how to code it, take a look at that micrograd library and see how you could achieve something similar using an object oriented approach.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts