petastorm VS horovod

Compare petastorm vs horovod and see what are their differences.

petastorm

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code. (by uber)

horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet. (by horovod)
Our great sponsors
  • Scout APM - Less time debugging, more time building
  • OPS - Build and Run Open Source Unikernels
  • SonarLint - Deliver Cleaner and Safer Code - Right in Your IDE of Choice!
petastorm horovod
1 4
1,338 12,057
3.7% 1.5%
7.4 9.3
13 days ago 5 days ago
Python Python
Apache License 2.0 GNU General Public License v3.0 or later
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

petastorm

Posts with mentions or reviews of petastorm. We have used some of these posts to build our list of alternatives and similar projects.

horovod

Posts with mentions or reviews of horovod. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-12-07.

What are some alternatives?

When comparing petastorm and horovod you can also consider the following projects:

DeepDanbooru - AI based multi-label girl image classification system, implemented by using TensorFlow.

NudeNet - Neural Nets for Nudity Detection and Censoring

onepanel - The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.

pytorch-summary - Model summary in PyTorch similar to `model.summary()` in Keras

thinc - 🔮 A refreshing functional take on deep learning, compatible with your favorite libraries

AdamP - AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)

d2l-en - Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 300 universities from 55 countries including Stanford, MIT, Harvard, and Cambridge.

mpi4jax - Zero-copy MPI communication of JAX arrays, for turbo-charged HPC applications in Python :zap:

best-of-ml-python - 🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

jina - Cloud-native neural search framework for 𝙖𝙣𝙮 kind of data

nsfw_model - Keras model of NSFW detector

einops - Deep learning operations reinvented (for pytorch, tensorflow, jax and others)