Is Parallel Programming Hard, and, If So, What Can You Do About It? v2023.06.11a

1. ideas5

   1 6 5 7.3

   Discontinued Batch 5 of Ideas for Computing

   https://github.com/samsquire/ideas5/blob/main/NonblockingRun...

   The design is that we have three groupings of thread types. The application starts up some application threads which are not associated with a request, these service multiconsumer multiproducer thread safe ringbuffers in lightweight threads with a Go-erlang-like lightweight process runtime. (My simple lightweight thread runtime is https://github.com/samsquire/preemptible-thread) We also multiplex multiple network clients sockets across a set number of kernel threads which I call control threads. Their responsibility is to dispatch work to a work stealing thread pool ASAP which has its own group of threads. So we pay a thread synchronization cost ONCE per IO which is the dispatch from the control thread to a thread pool thread. (Presumably this is fast, because the thread pool threads are all looping on a submission queue)

   We split all IO and CPU tasks into two halves: submit and handle reply. I assume you can use liburing or epoll in the control threads. The same with CPU tasks and use ringbuffers to communicate between threads. We can always serve client's requests because we're never blocked on handling someone else's request. The control thread is always unblocked.

   I think this article is good regarding Python's asyncio story:

2. CodeRabbit

   coderabbit.ai featured

   CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

   

3. preemptible-thread

   2 16 24 5.1 C

   Discontinued How to preempt threads in user space

   https://github.com/samsquire/ideas5/blob/main/NonblockingRun...

   The design is that we have three groupings of thread types. The application starts up some application threads which are not associated with a request, these service multiconsumer multiproducer thread safe ringbuffers in lightweight threads with a Go-erlang-like lightweight process runtime. (My simple lightweight thread runtime is https://github.com/samsquire/preemptible-thread) We also multiplex multiple network clients sockets across a set number of kernel threads which I call control threads. Their responsibility is to dispatch work to a work stealing thread pool ASAP which has its own group of threads. So we pay a thread synchronization cost ONCE per IO which is the dispatch from the control thread to a thread pool thread. (Presumably this is fast, because the thread pool threads are all looping on a submission queue)

   We split all IO and CPU tasks into two halves: submit and handle reply. I assume you can use liburing or epoll in the control threads. The same with CPU tasks and use ringbuffers to communicate between threads. We can always serve client's requests because we're never blocked on handling someone else's request. The control thread is always unblocked.

   I think this article is good regarding Python's asyncio story:

4. tokio

   3 219 28,182 9.5 Rust

   A runtime for writing reliable asynchronous applications with Rust. Provides I/O, networking, scheduling, timers, ...

   

   what about "green threads" that is not managed by the OS like https://tokio.rs ?

5. swift-corelibs-libdispatch

   4 3 2,499 5.4 C

   The libdispatch Project, (a.k.a. Grand Central Dispatch), for concurrency on multicore hardware

   

   GCD/libdispatch is a fantastic approach to concurrency and you can build and install support for non-Apple operating systems:

   https://github.com/apple/swift-corelibs-libdispatch

   Here’s a simple echo server:

   https://github.com/williamcotton/c_playground/blob/master/sr...

   Here’s a simple multithreaded database pool:

   https://github.com/williamcotton/express-c/blob/master/src/d...

6. c_playground

   5 1 0 5.1 C

   C Playground

   

   GCD/libdispatch is a fantastic approach to concurrency and you can build and install support for non-Apple operating systems:

   https://github.com/apple/swift-corelibs-libdispatch

   Here’s a simple echo server:

   https://github.com/williamcotton/c_playground/blob/master/sr...

   Here’s a simple multithreaded database pool:

   https://github.com/williamcotton/express-c/blob/master/src/d...

7. express-c

   6 7 18 5.8 C

   Fast, unopinionated, minimalist web framework for C

   

   GCD/libdispatch is a fantastic approach to concurrency and you can build and install support for non-Apple operating systems:

   https://github.com/apple/swift-corelibs-libdispatch

   Here’s a simple echo server:

   https://github.com/williamcotton/c_playground/blob/master/sr...

   Here’s a simple multithreaded database pool:

   https://github.com/williamcotton/express-c/blob/master/src/d...

8. futhark

   7 56 2,491 9.7 Haskell

   :boom::computer::boom: A data-parallel functional programming language

   

   Functional programming can be a great way to handle parallel programming in a sane way. See the Futhark language [1], for example, that accepts high-level constructs like map and convert them to the appropriate machine code, either on the CPU or the GPU.

   [1] https://futhark-lang.org/

9. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

10. ThreadPool

    8 8 8,187 0.0 C++

    A simple C++11 Thread Pool implementation

    

    And in C++ can also use this dead-simple header file for a nice high-level, modern threadpool using function objects (lambdas) for very easy parallelization of arbitrary tasks: https://github.com/progschj/ThreadPool

11. Hopac

    9 4 525 0.0 F#

    http://hopac.github.io/Hopac/Hopac.html

    

    https://github.com/Hopac/Hopac is such an impressive piece of software. Too bad it never really took off like it deserved but with more popular competition like rx or just tasks/async (which is enough for most stuff) pretty unavoidable.

Suggest a related project