Any Deep ReLU Network Is Shallow

• neural-tangents

  4 2,225 7.6 Jupyter Notebook

  Fast and Easy Infinite Neural Networks in Python

  

is used to capture the power of a fully-trained deep net of infinite width.

https://openreview.net/pdf?id=rkl4aESeUH, https://github.com/google/neural-tangents

> It has long been known that a single-layer fully-connected neural network with an i.i.d. prior over its parameters is equivalent to a Gaussian process (GP), in the limit of infinite network width.

https://arxiv.org/abs/1711.00165

And of course, one needs to look back at SVMs applying a kernel function and separating with a line, which looks a lot like an ANN with a single hidden layer followed by a linear mapping.

https://stats.stackexchange.com/questions/238635/kernel-meth...

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project