18335
MPI.jl
18335 | MPI.jl | |
---|---|---|
1 | 3 | |
473 | 361 | |
0.8% | 1.1% | |
0.0 | 7.8 | |
8 days ago | 22 days ago | |
Jupyter Notebook | Julia | |
- | The Unlicense |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
18335
-
Why Fortran is easy to learn
I would say Fortran is a pretty great language for teaching beginners in numerical analysis courses. The only issue I have with it is that, similar to using C+MPI (which is what I first learned with, well after a bit of Java), the students don't tend to learn how to go "higher level". You teach them how to write a three loop matrix-matrix multiplication, but the next thing you should teach is how to use higher level BLAS tools and why that will outperform the 3-loop form. But Fortran then becomes very cumbersome (`dgemm` etc.) so students continue to write simple loops and simple algorithms where they shouldn't. A first numerical analysis course should teach simple algorithms AND why the simple algorithms are not good, but a lot of instructors and tools fail to emphasize the second part of that statement.
On the other hand, the performance + high level nature of Julia makes it a rather excellent tool for this. In MIT graduate course 18.337 Parallel Computing and Scientific Machine Learning (https://github.com/mitmath/18337) we do precisely that, starting with direct optimization of loops, then moving to linear algebra, ODE solving, and implementing automatic differentiation. I don't think anyone would want to give a homework assignment to implement AD in Fortran, but in Julia you can do that as something shortly after looking at loop performance and SIMD, and that's really something special. Steven Johnson's 18.335 graduate course in Numerical Analysis (https://github.com/mitmath/18335) showcases some similar niceties. I really like this demonstration where it starts from scratch with the 3 loops and shows how SIMD and cache-oblivious algorithms build towards BLAS performance, and why most users should ultimately not be writing such loops (https://nbviewer.org/github/mitmath/18335/blob/master/notes/...) and should instead use the built-in `mul!` in most scenarios. There's very few languages where such "start to finish" demonstrations can really be showcased in a nice clear fashion.
MPI.jl
-
Parallélisation distribuée presque triviale d’applications GPU et CPU basées sur des Stencils avec…
GitHub - JuliaParallel/MPI.jl: MPI wrappers for Julia
- Why Fortran is easy to learn
-
MPI and HPC libraries
I have actually had good success with Julia for this: https://github.com/JuliaParallel/MPI.jl. I acknowledge this community may not appreciate me sharing that.
What are some alternatives?
GPUCompiler.jl - Reusable compiler infrastructure for Julia GPU backends.
ImplicitGlobalGrid.jl - Almost trivial distributed parallelization of stencil-based GPU and CPU applications on a regular staggered grid
Octavian.jl - Multi-threaded BLAS-like library that provides pure Julia matrix multiplication
DataFrames.jl - In-memory tabular data in Julia
Fortran-code-on-GitHub - Directory of Fortran codes on GitHub, arranged by topic
Makie.jl - Interactive data visualizations and plotting in Julia
SuiteSparse.jl - Development of SuiteSparse.jl, which ships as part of the Julia standard library.
SciMLBenchmarks.jl - Scientific machine learning (SciML) benchmarks, AI for science, and (differential) equation solvers. Covers Julia, Python (PyTorch, Jax), MATLAB, R
Pkg.jl - Pkg - Package manager for the Julia programming language
CUDA.jl - CUDA programming in Julia.