The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →
Top 23 High Performance Open-Source Projects
-
Tauri seemed like the "thing" I should switch to because everybody loves Rust (heh), and because it ships significantly smaller apps.
-
Project mention: Pake – Turn any webpage into a desktop app with Rust | news.ycombinator.com | 2023-11-29
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
Project mention: Java virtual threads caused a deadlock in TPC-C for PostgreSQL | news.ycombinator.com | 2024-01-15
Looks like HikariCP is also awaiting fixes for this https://github.com/brettwooldridge/HikariCP/pull/2055
-
https://lmax-exchange.github.io/disruptor/#_what_is_the_disr.... Unfortunately IIUC writing this in Go still prevents the spin-locked acceptor thread from achieving the kind of performance you could get in a non-GC language, unless you chose to disable GC, so I'd guess Envoy is still faster.
https://gnet.host/docs/quickstart/ it's nice that you can use this simply though. Envoy is kind of tricky to setup with custom filters, so most of the time it's just a standalone binary.
[0] https://blog.envoyproxy.io/envoy-threading-model-a8d44b92231...
[1] https://lmax-exchange.github.io/disruptor/#_what_is_the_disr...
-
Project mention: Spark – A web micro framework for Java and Kotlin | news.ycombinator.com | 2024-02-10
It's actively maintained with full time developers, performant, supports Kotlin out of the box, and has more features?
-
-
curl --silent --remote-name --location https://github.com/ceph/ceph/raw/octopus/src/cephadm/cephadmchmod a+x cephadm./cephadm bootstrap --mon-ip 192.168.1.41
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
Kotlin also has a construct for asynchronous collections/streams. Kotlin's version of AsyncSequence is called a Flow. Just as Swift's AsyncSequence builds upon prior experience with RxSwift and Combine, Kotlin's Flow APIs build upon earlier stream/collection APIs in the JVM ecosystem: Java's RxJava, Java8 Streams, Project Reactor, and Scala's Akka.
-
edgedb
A graph-relational database with declarative schema, built-in migration system, and a next-generation query language
Project mention: EdgeDB – A graph-relational database with declarative schema | news.ycombinator.com | 2024-02-10 -
Workerman
An asynchronous event driven PHP socket framework. Supports HTTP, Websocket, SSL and other custom protocols.
Project mention: Scaling to ~15K requests per second with Java – Part 1 | news.ycombinator.com | 2023-07-14I remember a consulting gig where they were pushing 50k requests per second with PHP in a 2018 laptop by using this framework https://github.com/walkor/workerman
In a real application, with database connection pooling and auth sessions, it went down to 15k requests/s.
And that was PHP7. PHP8 introduced JIT so it's probably significantly faster these days and hopefully fully typed.
-
I wound up on a different team with pre-existing Python code so temporarily shelved my use of Go for a bit, and we used Sanic (an async Python framework built on top of the excellent uvloop & libuv that also powers Node.js) to build some APIs for live channel management & operations. We hand-wrote our OpenAPI and used it to generate documentation and a CLI, which was an improvement over what was there (or not) before. Other teams used the OpenAPI document to generate SDKs to interact with our service.
-
hyperswitch
An open source payments switch written in Rust to make payments fast, reliable and affordable
🚨 BTW we are hiring for several roles, apply here.
-
Project mention: Ask HN: Is there a way to use Python statically typed or with any type-checking? | news.ycombinator.com | 2023-08-06
-
yugabyte-db
YugabyteDB - the cloud native distributed SQL database for mission-critical applications.
Project mention: Best Practice: use the same datatypes for comparisons, like joins and foreign keys | dev.to | 2024-02-01It is possible to apply Batched Nested Loop but with additional code that checks the range of the outer bigint and compare it only if it matches the range of integer. This has been added in YugabyteDB 2.21 with #20715 YSQL: Allow BNL on joins over different integer types to help migrations from PostgreSQL with such datatype inconsistencies.
-
Project mention: Engineers who have a personal website/blog, what are you using to host/generate it? | /r/ExperiencedDevs | 2023-05-01
I use Hugo with the papermod theme
-
swift-nio
Event-driven network application framework for high performance protocol servers & clients, non-blocking.
Project mention: Is it possible/straightforward to have a webserver baked in to an iOS app? | /r/iOSProgramming | 2023-05-05In addition to what others have said, SwiftNIO is a possible low-level web server framework.
-
- Dropbox [3] uses a similar approach but they talk about it a bit more abstractly.
Sans-IO is more documented in Python [4], but str0m [5] and quinn-proto [6] are the best examples in Rust I’m aware of. Note that sans-IO is orthogonal to deterministic test frameworks, but it composes well with them.
With the disclaimer that my opinions are mine and mine alone, and don’t reflect the company I work at —— I do work at a rust shop that has utilized these techniques on some projects.
TigerBeetle is an amazing example and I’ve looked at it before! They are really the best example of this approach outside of FoundationDB I think.
[0]: https://risingwave.com/blog/deterministic-simulation-a-new-e...
[1]: https://risingwave.com/blog/applying-deterministic-simulatio...
[2]: https://dropbox.tech/infrastructure/-testing-our-new-sync-en...
[3]: https://github.com/spacejam/sled
[4]: https://fractalideas.com/blog/sans-io-when-rubber-meets-road...
[5]: https://github.com/algesten/str0m
[6]: https://docs.rs/quinn-proto/0.10.6/quinn_proto/struct.Connec...
-
recent PR: https://github.com/confluentinc/librdkafka/pull/4275
-
seatunnel
SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
-
-
burn
Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.
[package] name = "resnet_burn" version = "0.1.0" edition = "2021" [dependencies] burn = { git = "https://github.com/tracel-ai/burn.git", rev = "75cb5b6d5633c1c6092cf5046419da75e7f74b11", features = ["ndarray"] } burn-import = { git = "https://github.com/tracel-ai/burn.git", rev = "75cb5b6d5633c1c6092cf5046419da75e7f74b11" } image = { version = "0.24.7", features = ["png", "jpeg"] }
-
Project mention: Ask HN: Is Python async/await some kind of joke? | news.ycombinator.com | 2024-01-27
- SqlAlchemy/asyncpg => you can’t use it if you’re using PgBouncer (necessary most of the time with Postgres) in transaction mode? What?? https://github.com/MagicStack/asyncpg/issues/1058
-
Since most of the time would be spent decoding json, you could try to cut this time using https://github.com/bytedance/sonic or https://github.com/json-iterator/go, both are drop-in replacements for the stdlib, sonic is faster.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
High Performance related posts
- Tauri + React + ShadcnUI
- Slint 1.5: Embracing Android, Improving Live-Preview, and Pythonic Slint
- Gnet is the fastest networking framework in Go
- 1BRC Merykitty's Magic SWAR: 8 Lines of Code Explained in 3k Words
- Libreactor: High performance, robust and secure event-driven Linux framework
- Tauri - Rust, Js and Native Apps
- EdgeDB – A graph-relational database with declarative schema
-
A note from our sponsor - WorkOS
workos.com | 28 Mar 2024
Index
What are some of the best open-source High Performance projects? This list will help you:
Project | Stars | |
---|---|---|
1 | tauri | 76,213 |
2 | Pake | 22,517 |
3 | HikariCP | 19,310 |
4 | Disruptor | 16,955 |
5 | Vert.x | 14,018 |
6 | codon | 13,760 |
7 | Ceph | 13,088 |
8 | Akka | 12,905 |
9 | edgedb | 12,152 |
10 | Workerman | 10,890 |
11 | uvloop | 9,940 |
12 | hyperswitch | 9,363 |
13 | Cython | 8,821 |
14 | yugabyte-db | 8,436 |
15 | hugo-PaperMod | 8,399 |
16 | swift-nio | 7,726 |
17 | sled | 7,679 |
18 | librdkafka | 7,233 |
19 | seatunnel | 7,154 |
20 | cowboy | 7,136 |
21 | burn | 6,716 |
22 | asyncpg | 6,551 |
23 | sonic | 6,174 |