[D] What is the recommended approach to training NN on big data set?

• ecosystem

  4 1,365 0.0 Scala

  Integration of TensorFlow with other open-source frameworks

  

I have a big data set that I would like to train on, so my thought is that I am going to do distributed training , but I am currently setting up MultiWorkerMirroredStrategy on tensorflow and i find it hard to use even with https://github.com/tensorflow/ecosystem/tree/master/spark/spark-tensorflow-distributor

• horovod

  8 13,942 5.8 Python

  Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

  

And in case scaling is really important to you. May I suggest you look into Horovod?

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project