rkyv is faster than {bincode, capnp, cbor, flatbuffers, postcard, prost, serde_json}

• rust_serialization_benchmark

  22 514 7.7 Rust

  Benchmarks for rust serialization frameworks

The prost serialize benchmarks are calling serialize\_pb() in the inner loop. That is creating a brand new instance of the message type. I see something similar in the capnp version here, but not for rkyv. I haven't used the rkyv API before so I may be misunderstanding, and they are all doing creation + encoding in the serialization inner loop?

• bytecheck

  2 58 6.5 Rust

  Memory validation framework for Rust

  

I will also plug bytecheck, which I wrote specifically to address the security problems with rkyv. It allows you to thoroughly verify data integrity and I always recommend that people use it when dealing with data they cannot trust. For trusted data there's no issue, and there are other alternatives that are more performant for untrusted data as well.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• nachricht

  4 74 0.0 Rust

  A self-describing data interchange format

• rust-serialization-benchmarks

  1 89 0.0 Rust

Right, great question. I referenced one benchmark in the post that separated the populate and serialize steps. This is a bit of a fuzzy patch for the methodology: what should count as serialization? I think there could be arguments either way:

• tree-buf

  3 252 0.0 Rust

  An experimental serialization system written in Rust

I think this is great. Could you add tree-buf as well to your benchmarks?

• rkyv

  13 2,572 8.9 Rust

  Zero-copy deserialization framework for Rust

  

I encourage you to definitely try it out for your use case and see what works and what doesn't. If you do run into any sharp edges, add your experience to the feedback thread!

• unsafe-code-guidelines

  74 640 6.9

  Forum for discussion about what unsafe code can and can't do

  

I don't think that rkyv will be able to guarantee set these bytes to zero (or any other value) after reading some internals discussions. You may be able to use the regular hash of your data to do something similar:

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project