Top 23 C++ Parallel Projects

• LightGBM

  11 16,043 9.2 C++

  A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

  

Project mention: SIRUS.jl: Interpretable Machine Learning via Rule Extraction | /r/Julia | 2023-06-29

SIRUS.jl is a pure Julia implementation of the SIRUS algorithm by Bénard et al. (2021). The algorithm is a rule-based machine learning model meaning that it is fully interpretable. The algorithm does this by firstly fitting a random forests and then converting this forest to rules. Furthermore, the algorithm is stable and achieves a predictive performance that is comparable to LightGBM, a state-of-the-art gradient boosting model created by Microsoft. Interpretability, stability, and predictive performance are described in more detail below.

• Taskflow

  24 9,552 7.9 C++

  A General-purpose Parallel and Heterogeneous Task Programming System

  

Project mention: Improvements of Clojure in his time | /r/Clojure | 2023-06-16

For parallel programming nowadays, personally I reach for C++ Taskflow when I really care about performance, or a mix of core.async and running multiple load balanced instances when I’m doing more traditional web backend stuff in Clojure.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• napajs

  6 9,238 0.0 C++

  Napa.js: a multi-threaded JavaScript runtime

  

Project mention: A list of JavaScript engines, runtimes, interpreters | /r/learnjavascript | 2023-12-10

Napa.js

• root

  31 2,418 10.0 C++

  The official repository for ROOT: analyzing, storing and visualizing big data, scientifically

  

Project mention: If you can't reproduce the model then it's not open-source | news.ycombinator.com | 2024-01-17

I think the process of data acquisition isn't so clear-cut. Take CERN as an example: they release loads of data from various experiments under the CC0 license [1]. This isn't just a few small datasets for classroom use; we're talking big-league data, like the entire first run data from LHCb [2].

On their portal, they don't just dump the data and leave you to it. They've got guides on analysis and the necessary tools (mostly open source stuff like ROOT [3] and even VMs). This means anyone can dive in. You could potentially discover something new or build on existing experiment analyses. This setup, with open data and tools, ticks the boxes for reproducibility. But does it mean people need to recreate the data themselves?

Ideally, yeah, but realistically, while you could theoretically rebuild the LHC (since most technical details are public), it would take an army of skilled people, billions of dollars, and years to do it.

This contrasts with open source models, where you can retrain models using data to get the weights. But getting hold of the data and the cost to reproduce the weights is usually prohibitive. I get that CERN's approach might seem to counter this, but remember, they're not releasing raw data (which is mostly noise), but a more refined version. Try downloading several petabytes of raw data if not; good luck with that. But for training something like a LLM, you might need the whole dataset, which in many cases have its own problems with copyrights…etc.

[1] https://opendata.cern.ch/docs/terms-of-use

[2] https://opendata.cern.ch/docs/lhcb-releases-entire-run1-data...

[3] https://root.cern/

• parallel-hashmap

  31 2,316 7.8 C++

  A family of header-only, very fast and memory-friendly hashmap and btree containers.

Project mention: The One Billion Row Challenge in CUDA: from 17 minutes to 17 seconds | news.ycombinator.com | 2024-04-13

Standard library maps/unordered_maps are themselves notoriously slow anyway. A sparse_hash_map from abseil or parallel-hashmaps[1] would be better.

[1] https://github.com/greg7mdp/parallel-hashmap

• thread-pool

  6 1,924 4.2 C++

  BS::thread_pool: a fast, lightweight, and easy-to-use C++17 thread pool library

• moose

  4 1,570 10.0 C++

  Multiphysics Object Oriented Simulation Environment

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Vc

  6 1,418 6.1 C++

  SIMD Vector Classes for C++

  

• RaftLib

  0 923 5.7 C++

  The RaftLib C++ library, streaming/dataflow concurrency via C++ iostream-like operators

  

• HiGHS

  3 800 9.8 C++

  Linear optimization software

  

Project mention: Algorithms - Researchers Approach New Speed Limit for Seminal Problem | news.ycombinator.com | 2024-01-29

• libfork

  1 452 9.8 C++

  A bleeding-edge, lock-free, wait-free, continuation-stealing tasking library built on C++20's coroutines

• libgrape-lite

  3 365 6.3 C++

  🍇 A C++ library for parallel graph processing (GRAPE) 🍇

  

• rapidgzip

  14 314 9.6 C++

  Gzip Decompression and Random Access for Modern Multi-Core Machines

Project mention: Show HN: Rapidgzip – Parallel Gzip Decompressing with 10 GB/S | news.ycombinator.com | 2023-09-04

• YACLib

  3 246 5.4 C++

  Yet Another Concurrency Library

  

• cvise

  2 195 8.1 C++

  Super-parallel Python port of the C-Reduce

• rangeless

  1 192 0.0 C++

  c++ LINQ -like library of higher-order functions for data manipulation

• ips4o

  2 159 1.8 C++

  In-place Parallel Super Scalar Samplesort (IPS⁴o)

• elbencho

  2 147 7.5 C++

  A distributed storage benchmark for file systems, object stores & block devices with support for GPUs

• rocPRIM

  1 143 8.5 C++

  ROCm Parallel Primitives

  

• firebuild

  6 117 9.1 C++

  Automatic build accelerator cache for Linux

  

Project mention: I Improved My Rust Compile Times by 75% | news.ycombinator.com | 2024-03-19

• charly-vm

  2 93 0.0 C++

  Fully parallel dynamically typed programming language

• indexed_bzip2

  1 66 9.6 C++

  Fast parallel random access to bzip2 and gzip files in Python

• ParallelReductionsBenchmark

  2 59 4.6 C++

  Thrust, CUB, TBB, AVX2, CUDA, OpenCL, OpenMP, SyCL - all it takes to sum a lot of numbers fast!

  

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

C++ Parallel related posts

• Experimental Parallel JSON Parser - vztpv/scj3, claujson (Using modified simdjson as Tokenizer, and some code of rapidjson - when ast->text, and std::thread)
  1 project | /r/cpp | 6 Nov 2023
• New Fast Python CVT MAP-Elites + CMA-ES implementation
  1 project | /r/optimization | 7 Nov 2022
• How we use binary search to find compiler bugs
  1 project | news.ycombinator.com | 20 Oct 2022
• Optimization for Quantum Computer Simulations
  1 project | /r/optimization | 23 Aug 2022
• Transaction and Payment Optimization Problem
  2 projects | /r/optimization | 11 Aug 2022
• Use One Big Server
  2 projects | news.ycombinator.com | 2 Aug 2022
• A new fast local search heuristic for a location problem
  1 project | /r/OperationsResearch | 30 Jul 2022
• A note from our sponsor - SaaSHub
  www.saashub.com | 26 Apr 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending C++ projects with our weekly report!