Distributed Computing

Open-source projects categorized as Distributed Computing
Edit details
Language: + Python + C# + Rust + Go + PHP + C++ + Java + C
Topics: Distributed Systems Machine Learning Cloud Python Distributed
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
Sponsored

Top 23 Distributed Computing Open-Source Projects

  • ColossalAI

    Making large AI models cheaper, faster and more accessible

    • Project mention: FLaNK AI-April 22, 2024 | dev.to | 2024-04-22

  • oceanbase

    OceanBase is an enterprise distributed relational database with high availability, high performance, horizontal scalability, and compatibility with SQL standards.

    • Project mention: Show HN: OceanBase – An open-source distributed SQL database written in C++ | news.ycombinator.com | 2023-05-23

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • Hazelcast

    Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

    • Project mention: Does anyone know any good java implementations for distributed key-value store? | /r/ExperiencedDevs | 2023-06-08

    You're probably looking for Hazelcast here. Note that it does much more than just a distributed k/v, but it will get you where you need to go.

  • protoactor-go

    Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

    • Project mention: Is there a programming language that will blow my mind? | /r/ProgrammingLanguages | 2023-06-01

    https://github.com/asynkron/protoactor-go & this is a great lib, that implements a Erlang/Akka-like the Actor Model in Go.

  • Akka.net

    Canonical actor model implementation for .NET with local + distributed actors in C# and F#.

    • Project mention: What is the fastest producer consumer model in C# | /r/dotnet | 2023-11-06

    akka.net actors. Actors all the way! https://getakka.net

  • gleam

    Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly. (by chrislusf)

  • catalyst

    Accelerated deep learning R&D (by catalyst-team)

    • Project mention: Instance segmentation of small objects in grainy drone imagery | /r/computervision | 2023-12-09

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • alpa

    Training and serving large-scale neural networks with auto parallelization.

  • inference

    Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

    • Project mention: GreptimeAI + Xinference - Efficient Deployment and Monitoring of Your LLM Applications | dev.to | 2024-01-24

    Xorbits Inference (Xinference) is an open-source platform to streamline the operation and integration of a wide array of AI models. With Xinference, you’re empowered to run inference using any open-source LLMs, embedding models, and multimodal models either in the cloud or on your own premises, and create robust AI-driven applications. It provides a RESTful API compatible with OpenAI API, Python SDK, CLI, and WebUI. Furthermore, it integrates third-party developer tools like LangChain, LlamaIndex, and Dify, facilitating model integration and development.

  • Graph Engine

    Microsoft Graph Engine (by microsoft)

  • boinc

    Open-source software for volunteer computing and grid computing.

    • Project mention: Bitcoin Block 840000 | news.ycombinator.com | 2024-04-19

    The only way I can foresee a cryptocoin actually holding value is if spending the coin meant spending processing cycles and RAM doing things like this:

    https://en.wikipedia.org/wiki/List_of_volunteer_computing_pr...

    But in more general sense, less like https://boinc.berkeley.edu/ and more like AWS...

    It's the only way to have value, actually holding computing power in a distributed network.

  • fugue

    A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

    • Project mention: FLaNK Stack Weekly 22 January 2024 | dev.to | 2024-01-22

  • Daft

    Distributed DataFrame for Python designed for the cloud, powered by Rust

    • Project mention: Daft: Distributed DataFrame for Python | news.ycombinator.com | 2024-02-29

    There are benchmarks here - https://github.com/Eventual-Inc/Daft?tab=readme-ov-file#benc.... Seems to outperform Dask by a fair bit.

  • protoactor-dotnet

    Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

  • MooseFS

    MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

    • Project mention: Google Cloud Storage FUSE | news.ycombinator.com | 2023-05-02

  • distributed

    A distributed task scheduler for Dask

  • hashtopolis

    Hashtopolis - distributed password cracking with Hashcat

  • zenoh

    zenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.

    • Project mention: Eclipse Zenoh 0.10.0 is out | /r/rust | 2023-10-04

  • vizier

    Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.

  • .NET port of LMAX Disruptor

    Port of LMAX Disruptor to .NET

  • IdGen

    Twitter Snowflake-alike ID generator for .Net

  • holochain

    The current, performant & industrial strength version of Holochain on Rust.

  • SmartSql

    SmartSql = MyBatis in C# + .NET Core+ Cache(Memory | Redis) + R/W Splitting + PropertyChangedTrack +Dynamic Repository + InvokeSync + Diagnostics

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Distributed Computing related posts

Index

What are some of the best open-source Distributed Computing projects? This list will help you:

Project Stars
1 ColossalAI 37,836
2 oceanbase 7,340
3 Hazelcast 5,861
4 protoactor-go 4,862
5 Akka.net 4,612
6 gleam 3,362
7 catalyst 3,223
8 alpa 2,979
9 inference 2,424
10 Graph Engine 2,176
11 boinc 1,915
12 fugue 1,869
13 Daft 1,666
14 protoactor-dotnet 1,658
15 MooseFS 1,583
16 distributed 1,540
17 hashtopolis 1,349
18 zenoh 1,243
19 vizier 1,171
20 .NET port of LMAX Disruptor 1,160
21 IdGen 1,123
22 holochain 1,108
23 SmartSql 1,045

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com