high-performance-computing

Open-source projects categorized as high-performance-computing

Top 23 high-performance-computing Open-Source Projects

  • Taskflow

    A General-purpose Parallel and Heterogeneous Task Programming System

    Project mention: Improvements of Clojure in his time | /r/Clojure | 2023-06-16

    For parallel programming nowadays, personally I reach for C++ Taskflow when I really care about performance, or a mix of core.async and running multiple load balanced instances when I’m doing more traditional web backend stuff in Clojure.

  • metaflow

    :rocket: Build and manage real-life ML, AI, and data science projects with ease!

    Project mention: FLaNK Stack 05 Feb 2024 | dev.to | 2024-02-05
  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • tf-quant-finance

    High-performance TensorFlow library for quantitative finance.

    Project mention: tf-quant-finance: NEW Derivatives and Hedging - star count:3911.0 | /r/algoprojects | 2023-06-10
  • FluidX3D

    The fastest and most memory efficient lattice Boltzmann CFD software, running on all GPUs via OpenCL.

    Project mention: FluidX3D | news.ycombinator.com | 2024-03-24
  • alpa

    Training and serving large-scale neural networks with auto parallelization.

  • awesome-tensor-compilers

    A list of awesome compiler projects and papers for tensor computation and deep learning.

    Project mention: MatX: Faster Chips for LLMs | news.ycombinator.com | 2023-08-05

    > So long as Pytorch only practically works with Nvidia GPUs, everything else is little more than a rounding error.

    This is changing.

    https://github.com/merrymercy/awesome-tensor-compilers

    There are more and better projects that can compile an existing PyTorch codebase into a more optimized format for a range of devices. Triton (which is part of PyTorch) TVM and the MLIR based efforts (like torch-MLIR or IREE) are big ones, but there are smaller fish like GGML and Tinygrad, or more narrowly focused projects like Meta's AITemplate (which works on AMD datacenter GPUs).

    Hardware is in a strange place now... It feels like everyone but Cerebras and AMD/Intel was squeezed out, but with all the money pouring in, I think this is temporary.

  • blis

    BLAS-like Library Instantiation Software Framework

    Project mention: Optimize sgemm on RISC-V platform | news.ycombinator.com | 2024-02-28

    There is a recent update to the blis alternative to BLAS that includes a number of RISC-V performance optimizations.

    https://github.com/flame/blis/pull/737

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • boinc

    Open-source software for volunteer computing and grid computing.

    Project mention: Distributed Inference and Fine-Tuning of Large Language Models over the Internet | news.ycombinator.com | 2024-01-02

    Made me think of Gridcoin and BOINC https://boinc.berkeley.edu/

  • kokkos

    Kokkos C++ Performance Portability Programming Ecosystem: The Programming Model - Parallel Execution and Memory Abstraction

  • hermit-rs

    Hermit for Rust.

    Project mention: Mirage – A programming framework for building type-safe, modular systems | news.ycombinator.com | 2023-11-23

    The rough Rust of this is https://github.com/hermit-os/hermit-rs

    Though last I looked it wasn't nearly as mature as MirageOS.

  • mfem

    Lightweight, general, scalable C++ library for finite element methods

  • drake

    An R-focused pipeline toolkit for reproducibility and high-performance computing (by ropensci)

  • Arraymancer

    A fast, ergonomic and portable tensor library in Nim with a deep learning focus for CPU, GPU and embedded devices via OpenMP, Cuda and OpenCL backends

    Project mention: Arraymancer – Deep Learning Nim Library | news.ycombinator.com | 2024-03-28

    It is a small DSL written using macros at https://github.com/mratsim/Arraymancer/blob/master/src/array....

    Nim has pretty great meta-programming capabilities and arraymancer employs some cool features like emitting cuda-kernels on the fly using standard templates depending on backend !

  • neanderthal

    Fast Clojure Matrix Library

  • kernel

    A Rust-based, lightweight unikernel.

    Project mention: Build Your Own Docker with Linux Namespaces, Cgroups, and Chroot | news.ycombinator.com | 2023-06-26
  • AdaptiveCpp

    Implementation of SYCL and C++ standard parallelism for CPUs and GPUs from all vendors: The independent, community-driven compiler for C++-based heterogeneous programming models. Lets applications adapt themselves to all the hardware in the system - even at runtime!

    Project mention: What Every Developer Should Know About GPU Computing | news.ycombinator.com | 2023-10-21

    Sapphire Rapids is a CPU.

    AMD's primary focus for a GPU software ecosystem these days seems to be implementing CUDA with s/cuda/hip, so AMD directly supports and encourages running GPU software written in CUDA on AMD GPUs.

    The only implementation for sycl on AMD GPUs that I can find is a hobby project that apparently is not allowed to use either the 'hip' or 'sycl' names. https://github.com/AdaptiveCpp/AdaptiveCpp

  • envpool

    C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.

    Project mention: How do I improve my SB3 PPO on an EnvPool environment | /r/reinforcementlearning | 2023-09-21

    I am looking to improve the overall performance as well as optimize the wall clock time. I slightly modified the code to develop a SB3 wrapper for envpool from here.

  • vectorious

    Linear algebra in TypeScript.

    Project mention: Vectorious: BLAS-accelerated linear algebra for TypeScript | /r/hypeurls | 2023-06-02
  • targets

    Function-oriented Make-like declarative workflows for R

  • openmc

    OpenMC Monte Carlo Code

    Project mention: The Law of Large Numbers, or Why It Is a Bad Idea to Go to the Casino | news.ycombinator.com | 2023-05-14

    It was actually invented for this.

    Open source radiation transport Monte Carlo code here if you'd like to play around:

    https://github.com/openmc-dev/openmc

  • preCICE

    A coupling library for partitioned multi-physics simulations, including, but not restricted to fluid-structure interaction and conjugate heat transfer simulations.

  • prometeo

    An experimental Python-to-C transpiler and domain specific language for embedded high-performance computing

    Project mention: Are there any libraries that can easily convert Python to C/C#/or C++? Ones where a person doesn't have to "calibrate" it, just, pip install library and then they can have their Python code in C,C#,or C++? | /r/learnpython | 2023-04-06
  • dace

    DaCe - Data Centric Parallel Programming

    Project mention: Looking for HLS frameworks to start deploying DL algorithms on FPGAs | /r/FPGA | 2023-06-20
  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-03-28.

high-performance-computing related posts

Index

What are some of the best open-source high-performance-computing projects? This list will help you:

Project Stars
1 Taskflow 9,455
2 metaflow 7,494
3 tf-quant-finance 4,235
4 FluidX3D 3,092
5 alpa 2,963
6 awesome-tensor-compilers 2,119
7 blis 2,018
8 boinc 1,894
9 kokkos 1,699
10 hermit-rs 1,571
11 mfem 1,502
12 drake 1,329
13 Arraymancer 1,187
14 neanderthal 1,042
15 kernel 1,031
16 AdaptiveCpp 1,017
17 envpool 993
18 vectorious 912
19 targets 855
20 openmc 683
21 preCICE 660
22 prometeo 610
23 dace 457
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com