kokkos VS pykokkos

I’m a novice user of Kokkos. Write code once for openmp, CUDA, and other parallel execution backends. It was designed with scientific computing applications in mind. Some numerics tools are implemented in “Kokkos kernels”, most of the BLAS operations are included iirc.

I would suggest using a C++ abstraction around thread parallelism. This will make your code easier to read and more concise, and will also make it easier to switch between different thread-parallel programming models. Kokkos is a lovely example of such an abstraction, but there are others. Modern C++ even has thread-parallel standard algorithms. Bryce Adelstein Lelbach's CppCon 2021 talk describes these.

It’s a work in progress, but Kokkos and the associated Kokkos Kernels are probably the closest thing to what you’re asking for.

Kokkos implements a programming model in C++ for writing performance portable applications targeting all major HPC platforms. It provides abstractions for both parallel execution of code and data management with a variety of backends including, but not limited to: CUDA, HIP, OpenMP, HPX, and Pthreads, with backends for OpenMPTarget and SYCL currently under development.

I see more and more Pythonic solvers due to JIT and similar techniques (Disclaimer: I don't use them to make solvers). This is an old diagram what you can use in your implementation. As I use Kokkos for two of my projects, I find attractive this new pykokkos thing. But there are specific libraries (dialects?) for numerics: like Taichi, Fenics and DOLFINx, etc.

Making these bindings available was a critical step in the progress toward writing Kokkos in native Python via pykokkos, which is currently available for Linux + Python 3.8 + GCC 7.5 + CUDA 10.2 toolchains.