Python Mpi

Open-source Python projects categorized as Mpi | Edit details

Top 4 Python Mpi Projects

  • GitHub repo horovod

    Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

    Project mention: [D] GPU buying recommendation | reddit.com/r/MachineLearning | 2021-07-17

    If you just want to run tensorflow or pytorch for a Jupyter notebook, setting the environment shouldn't be difficult. I know that AWS has a marketplace of preconfigured images. However, you can go as advanced as setting up a cluster of gpu-equipped nodes to setup Horovod (https://github.com/horovod/horovod) to do distributed machine learning. Yes, there's a learning curve, but you cannot acquire this skillet any other way.

  • GitHub repo pyccel

    Python extension language using accelerators

    Project mention: Python extension language using accelerators | news.ycombinator.com | 2021-09-22
  • Scout APM

    Scout APM: A developer's best friend. Try free for 14-days. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.

  • GitHub repo mpi4jax

    Zero-copy MPI communication of JAX arrays, for turbo-charged HPC applications in Python :zap:

    Project mention: [D] Jax (or other libraries) when not using GPUs/TPUs but CPUs. | reddit.com/r/MachineLearning | 2021-02-03

    I've seen a couple of posts of folks using JAX for scientific computing (e.g. physics) workloads without much issue. The parallel primitives work just as well across multiple CPUs as they do on accelerators. If you're on a cluster, also worth looking into https://github.com/PhilipVinc/mpi4jax.

  • GitHub repo es_pytorch

    High performance implementation of Deep neuroevolution in pytorch using mpi4py. Intended for use on HPC clusters

    Project mention: What is the greatest achievement of Genetic Algorithms[D]? | reddit.com/r/MachineLearning | 2020-12-29

    ES, specifically OpenAI's ES (and to an extent CMA-ES). This has been shown to be very competitive with modern state of the art RL algorithms. A huge benefit of it is that it's incredibly easy to implement (I'm gonna shamelessly plug my implementation if you want to see the inner workings)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2021-09-22.

Python Mpi related posts

Index

What are some of the best open-source Mpi projects in Python? This list will help you:

Project Stars
1 horovod 11,898
2 pyccel 186
3 mpi4jax 110
4 es_pytorch 18
Find remote jobs at our new job board 99remotejobs.com. There are 33 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com