Backpropagation and Accelerate

• backprop

  1 175 0.0 Haskell

  Heterogeneous automatic differentiation ("backpropagation") in Haskell

• ad

  4 345 4.6 Haskell

  Automatic Differentiation

  I’ll also link the ad package here in case someone can speak to its value over backprop https://github.com/ekmett/ad

• InfluxDB

  www.influxdata.com

  sponsored

  Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

  

• accelerate-ad

  1 20 10.0 Haskell

  Combinatory automatic differentiation in Haskell for heterogeneous computing.

  Now back to your question. I have a bit of experience with backprop and accelerate but it's neither recent nor with both of them at once. Accelerate has two layers of abstraction. There are Exp and Acc that build an AST. After compiling them with llvm-native or llvm-ptx backend you enter another layer of abstraction – functions Array -> Array -> ... -> Array. How much automatic you want AD to be? Automatic differentiation AST of Exps and Accs is going to be hard and backprop has nothing to help you here. There was a google summer of code project on this topic. As I understand, it ran short of completion.

Suggest a related project