Neural Architecture Search (NAS) [D]

• NaiveGAflux.jl

  2 41 7.3 Julia

  Evolve Flux networks from scratch!

Fwiw (and shameless plug disclaimer), I made a library for easily toying around with evolution based NAS. It uses mixed integer programming to align the neurons (e.g. when resizing a layer) which it gives much higher degrees of freedom over what architectures one can allow in the search space over anything else I have seen: https://github.com/DrChainsaw/NaiveGAflux.jl

• eigenlearning

  5 49 3.3 Jupyter Notebook

  codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"

In addition to using a validation set, there is research w.r.t. the neural tangent kernel which claims that metrics correlated to both training speed and generalization can be computed from the NTK. This would then remove/reduce the need for training as one can substitute it with computing the NTK. I don’t have a complete list of references, but here is one example and another where they have applied NTK (and number of linear regions) to NAS.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project