The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →
Top 13 zero-copy Open-Source Projects
-
incubator-fury
A blazingly fast multi-language serialization framework powered by JIT and zero-copy.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
Cekirdekler
Multi-device OpenCL kernel load balancer and pipeliner API for C#. Uses shared-distributed memory model to keep GPUs updated fast while using same kernel on all devices(for simplicity).
Project mention: FlatBuffers – an efficient cross platform serialization library for many langs | news.ycombinator.com | 2023-09-18
Project mention: Fast Cloud Native Java Serialization:Fury JIT and GraalVM Native Image AOT | news.ycombinator.com | 2023-12-01
Project mention: Müsli - An experimental binary serialization framework with more choice | /r/rust | 2023-05-18And before you ask: This only provides partial zero-copy support in strings and byte arrays like serde. But it's not like rkyv which constructs validated references into the data.
Project mention: Show HN: Comprehensive inter-process communication (IPC) toolkit in modern C++ | news.ycombinator.com | 2024-04-13Also, when you want to perform some access control with access rights, you have to face sid— and ace-strings - oh they are fun. And, of course, there are all the nasty details; for instance, Windows defines macros that lead to compilation failures since they collide with internal naming. Take a look at this here, maybe it makes your efforts less painless: https://github.com/eclipse-iceoryx/iceoryx/blob/master/iceor...
You could reuse the iceoryx platform layer that enables iceoryx to run on every platform from qnx, linux, freertos, mac, windows. Maybe it can help you as well: https://github.com/eclipse-iceoryx/iceoryx/blob/master/doc/w...
Project mention: Show HN: Iceoryx2 v0.3.0 released – zero-copy IPC middleware in Rust | news.ycombinator.com | 2024-04-18
Project mention: Show HN: Comprehensive inter-process communication (IPC) toolkit in modern C++ | news.ycombinator.com | 2024-04-13Oooh, so close. We’ve got the advertisement/discovery and messaging for sure.
Concretely what it would take to port it to those OS: https://github.com/Flow-IPC/ipc/issues/101
Given a couple weeks to work on it, this thing would be on macOS no problem. With Windows I personally need to understand its FD-passing and native handle concepts first, but I’m guessing it’d be a similar amount of effort in the end.
zero-copy related posts
- Show HN: Comprehensive inter-process communication (IPC) toolkit in modern C++
- A new major version of jql has been released
- Ask HN: What happened to flatbuffers? Are they being used?
- Pijul 1.0 Beta
- Is there a library like Serde but which makes it easy to mutate serialized data stored in a [u8] or Vec<u8>?
- Flexible, Fast & Compact Serialization with RPC
- NoProto: Flexible, Fast and Compact Serialization with RPC
-
A note from our sponsor - WorkOS
workos.com | 28 Apr 2024
Index
What are some of the best open-source zero-copy projects? This list will help you:
Project | Stars | |
---|---|---|
1 | FlatBuffers | 22,048 |
2 | incubator-fury | 2,609 |
3 | rkyv | 2,566 |
4 | bebop | 1,829 |
5 | cista | 1,642 |
6 | iceoryx | 1,517 |
7 | combine | 1,265 |
8 | NoProto | 362 |
9 | iceoryx2 | 346 |
10 | imstr | 238 |
11 | ipc | 193 |
12 | Cekirdekler | 93 |
13 | zero-copy-pads | 5 |
Sponsored