Distributed Training Made Easy with PyTorch-Ignite

• ignite

  3 4,455 8.7 Python

  High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently. (by pytorch)

  

PyTorch-Ignite's ignite.distributed (idist) submodule introduced in version v0.4.0 (July 2020) quickly turns single-process code into its data distributed version.

• NCCL

  3 2,808 5.8 C++

  Optimized primitives for collective multi-GPU communication

  

backends from native torch distributed configuration: nccl, gloo, mpi.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• gloo

  2 1,140 8.0 C++

  Collective communications library with various primitives for multi-machine training. (by facebookincubator)

  

backends from native torch distributed configuration: nccl, gloo, mpi.

• xla

  8 2,291 9.9 C++

  Enabling PyTorch on XLA Devices (e.g. Google TPU)

  

XLA on TPUs via pytorch/xla.

• idist-snippets

  1 4 0.0 Python
  

Code snippets, as well as commands for running all the scripts, are provided in a separate repository.

• why-ignite

  1 4 0.0 Python

  Why should we use PyTorch-Ignite ?

More information on launchers experiments can be found here.

• ompi

  10 2,008 9.7 C

  Open MPI main development repository

  

backends from native torch distributed configuration: nccl, gloo, mpi.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project