[D] Significant differences in Training on 1 GPU vs 8GPU ?

• moco

  4 4,569 3.7 Python

  PyTorch implementation of MoCo: https://arxiv.org/abs/1911.05722 (by facebookresearch)

  

I am looking at the official code for MOCO-v2 linear evaluation here: https://github.com/facebookresearch/moco The command to execute suggests running a 256 sized batch across 8 GPUs for a Resnet-50. Do keep in mind that for the linear evaluation the model is frozen till the end and only the final fully connected layer is fine-tuned.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project