Parsing Gigabytes of JSON per Second

• simdjson

  63 18,337 9.2 C++

  Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks

  

• cbor-java

  17 114 7.0 Java

  Java implementation of RFC 7049: Concise Binary Object Representation (CBOR)

JSON doesn't allow any custom type, so it is not "flexible" per se. Therefore you only need a format that supports the JSON data model and pretty much nothing else; CBOR [1] for example almost surely fits the bill.

[1] https://cbor.io/

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• Cap'n Proto

  66 11,163 9.3 C++

  Cap'n Proto serialization/RPC system - core tools and C++ library

  

I guess an example would be along the lines of protobufs, e.g. Cap’n Proto

https://capnproto.org/

(which I have never used but really enjoy just for its charming website design alone)

• pronto

  4 6 0.0 Java

  Protobuf ORM (by CaperAi)

  

I've written translation layers for such systems and it's not too bad. See this project from $job - 1: https://github.com/CaperAi/pronto

It allowed us to have a single model for storage in the DB, for sending between services, and syncing to edge devices.

• simd-json

  7 1,008 8.7 Rust

  Rust port of simdjson

  

• jsoniter

  3 1,486 0.0 Java

  jsoniter (json-iterator) is fast and flexible JSON parser available in Java and Go (by json-iterator)

  

Protobuf parsing is slower than an optimized json library, e.g. https://jsoniter.com/

Suggest a related project