Deep Learning With Flux: Loss Doesn't Converge

• CatsVsDogsJulia

  1 0 5.3 Julia

My entire script is on GitHub

• Flux.jl

  22 4,391 8.7 Julia

  Relax! Flux is the ML library that doesn't make you tensor

  

2) Flux treats softmax a little different than most other activation functions (see here for more details) such as relu and sigmoid. When you pass an activation function into a layer like Dense(3, 32, relu), Flux expects that the function is broadcast over the layer's output. However, softmax cannot be broadcast as it operates over vectors rather than scalars. This means that if you want to use softmax as the final activation in your model, you need to pass it into Chain() like so:

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project