parallel-computing

Top 23 parallel-computing Open-Source Projects

  • Taskflow

    A General-purpose Parallel and Heterogeneous Task Programming System

  • Project mention: Improvements of Clojure in his time | /r/Clojure | 2023-06-16

    For parallel programming nowadays, personally I reach for C++ Taskflow when I really care about performance, or a mix of core.async and running multiple load balanced instances when I’m doing more traditional web backend stuff in Clojure.

  • Joblib

    Computing with Python functions.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • CTranslate2

    Fast inference engine for Transformer models

  • Project mention: Distil-Whisper: distilled version of Whisper that is 6 times faster, 49% smaller | news.ycombinator.com | 2023-10-31

    Just a point of clarification - faster-whisper references it but ctranslate2[0] is what's really doing the magic here.

    Ctranslate2 is a sleeper powerhouse project that enables a lot. They should be up front and center and get the credit they deserve.

    [0] - https://github.com/OpenNMT/CTranslate2

  • swifter

    A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner (by jmcarpenter2)

  • kokkos

    Kokkos C++ Performance Portability Programming Ecosystem: The Programming Model - Parallel Execution and Memory Abstraction

  • mfem

    Lightweight, general, scalable C++ library for finite element methods

  • Vc

    SIMD Vector Classes for C++

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • awesome-machine-learning-in-compilers

    Must read research papers and links to tools and datasets that are related to using machine learning for compilers and systems optimisation

  • Project mention: Awesome research papers on ML in Compilers | /r/hypeurls | 2023-06-21
  • Arraymancer

    A fast, ergonomic and portable tensor library in Nim with a deep learning focus for CPU, GPU and embedded devices via OpenMP, Cuda and OpenCL backends

  • Project mention: Arraymancer – Deep Learning Nim Library | news.ycombinator.com | 2024-03-28

    It is a small DSL written using macros at https://github.com/mratsim/Arraymancer/blob/master/src/array....

    Nim has pretty great meta-programming capabilities and arraymancer employs some cool features like emitting cuda-kernels on the fly using standard templates depending on backend !

  • Symbolics.jl

    Symbolic programming for the next generation of numerical software

  • Project mention: Symbolics.jl | news.ycombinator.com | 2024-01-13
  • adaptive

    :chart_with_upwards_trend: Adaptive: parallel active learning of mathematical functions

  • Project mention: I made a Python package to do adaptive sampling of functions in parallel [OC] | /r/compsci | 2023-04-29

    Yes! Check it out at https://github.com/python-adaptive/adaptive/

  • elmerfem

    Official git repository of Elmer FEM software

  • pyopencl

    OpenCL integration for Python, plus shiny features

  • Kratos

    Kratos Multiphysics (A.K.A Kratos) is a framework for building parallel multi-disciplinary simulation software. Modularity, extensibility and HPC are the main objectives. Kratos has BSD license and is written in C++ with extensive Python interface. (by KratosMultiphysics)

  • future

    :rocket: R package: future: Unified Parallel and Distributed Processing in R for Everyone

  • accelerate

    Embedded language for high-performance array computations (by AccelerateHS)

  • grass

    GRASS GIS - free and open-source geospatial processing engine

  • Project mention: Geospatial Nix – create, use and deploy today | news.ycombinator.com | 2024-02-24

    https://grass.osgeo.org/

        GRASS GIS offers powerful raster, vector, and geospatial processing engines in a single integrated software suite. It includes tools for terrain and ecosystem modeling, hydrology, visualization of raster and vector data, management and analysis of geospatial data, and the processing of satellite and aerial imagery. It comes with a temporal framework for advanced time series processing and a Python API for rapid geospatial programming. GRASS GIS has been optimized for performance and large geospatial data analysis.

  • cccl

    CUDA C++ Core Libraries

  • Project mention: GDlog: A GPU-Accelerated Deductive Engine | news.ycombinator.com | 2023-12-03

    https://github.com/topics/datalog?l=rust ... Cozo, Crepe

    Crepe: https://github.com/ekzhang/crepe :

    > Crepe is a library that allows you to write declarative logic programs in Rust, with a Datalog-like syntax. It provides a procedural macro that generates efficient, safe code and interoperates seamlessly with Rust programs.

    Looks like there's not yet a Python grammar for the treeedb tree-sitter: https://github.com/langston-barrett/treeedb :

    > Generate Soufflé Datalog types, relations, and facts that represent ASTs from a variety of programming languages.

    Looks like roxi supports n3, which adds `=>` "implies" to the Turtle lightweight RDF representation: https://github.com/pbonte/roxi

    FWIW rdflib/owl-rl: https://owl-rl.readthedocs.io/en/latest/owlrl.html :

    > simple forward chaining rules are used to extend (recursively) the incoming graph with all triples that the rule sets permit (ie, the “deductive closure” of the graph is computed).

    ForwardChainingStore and BackwardChainingStore implementations w/ rdflib in Python: https://github.com/RDFLib/FuXi/issues/15

    Fast CUDA hashmaps

    Gdlog is built on CuCollections.

    GPU HashMap libs to benchmark: Warpcore, CuCollections,

    https://github.com/NVIDIA/cuCollections

    https://github.com/NVIDIA/cccl

    https://github.com/sleeepyjack/warpcore

    /? Rocm HashMap

    DeMoriarty/DOKsparse:

  • dolfinx

    Next generation FEniCS problem solving environment

  • oneMKL

    oneAPI Math Kernel Library (oneMKL) Interfaces

  • OpenTimer

    A High-performance Timing Analysis Tool for VLSI Systems

  • Hyperactive

    An optimization and data collection toolbox for convenient and fast prototyping of computationally expensive models.

  • Project mention: Hyperactive Version 4.5 Released | news.ycombinator.com | 2023-08-27
  • post-me

    📩 Use web Workers and other Windows through a simple Promise API

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

parallel-computing related posts

Index

What are some of the best open-source parallel-computing projects? This list will help you:

Project Stars
1 Taskflow 9,552
2 Joblib 3,656
3 CTranslate2 2,776
4 swifter 2,459
5 kokkos 1,718
6 mfem 1,537
7 Vc 1,418
8 awesome-machine-learning-in-compilers 1,327
9 Arraymancer 1,304
10 Symbolics.jl 1,288
11 adaptive 1,112
12 elmerfem 1,091
13 pyopencl 1,029
14 Kratos 958
15 future 929
16 accelerate 886
17 grass 766
18 cccl 758
19 dolfinx 652
20 oneMKL 565
21 OpenTimer 511
22 Hyperactive 487
23 post-me 480

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com