Horovod Alternatives
Similar projects and alternatives to horovod
-
petastorm
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
-
DeepDanbooru
AI based multi-label girl image classification system, implemented by using TensorFlow.
-
Sonar
Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
-
mpi4jax
Zero-copy MPI communication of JAX arrays, for turbo-charged HPC applications in Python :zap:
-
-
onepanel
The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.
-
pytorch-summary
Model summary in PyTorch similar to `model.summary()` in Keras
-
-
InfluxDB
Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises.
-
thinc
🔮 A refreshing functional take on deep learning, compatible with your favorite libraries
-
-
accelerate
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
-
-
stoke
A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-precision, and PyTorch extensions.
-
AdamP
AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)
horovod reviews and mentions
-
[D] What is the recommended approach to training NN on big data set?
And in case scaling is really important to you. May I suggest you look into Horovod?
-
[D] PyTorch Distributed Training Libraries: What are the current options?
Check out Horovod - https://github.com/horovod/horovod
Stats
horovod/horovod is an open source project licensed under GNU General Public License v3.0 or later which is an OSI approved license.