MessagePack
Protobuf
| MessagePack | Protobuf | |
|---|---|---|
| 2 | 183 | |
| 2,995 | 65,107 | |
| 1.0% | 0.6% | |
| 0.0 | 10.0 | |
| 26 days ago | 5 days ago | |
| C++ | ||
| GNU General Public License v3.0 or later | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
MessagePack
-
Serializing struct with bit-fields
I have searched extensively, and have tried a few libraries from msgpack-c (C++), to YAS, and a few more not to name.
-
Binary de-/serialization
how about https://github.com/msgpack/msgpack-c/tree/c_master ?
Protobuf
- What's new in C++26 (part 1)
-
Why should we use Protobuf in Web API as data transfer protocol.
Note: If you want to use the Google Protobuf compiler for code generation, download it from GitHub based on your OS. Follow this link for code generation instructions.
-
Another variable-length integer encoding
Unary length prefix is a solid technique. I would be careful with the performance claims, though. Sometimes what the machine can do is surprising and the performance of a system that looks like it needs to loop and branch is faster than you expected. The protobuf project, unsurprisingly for a project of its age, has several different varint parsing strategies. One is described at https://github.com/protocolbuffers/protobuf/blob/main/src/go... and another at https://github.com/protocolbuffers/protobuf/blob/main/src/go...
-
Parsing Protobuf Definitions with Tree-sitter
See protobuf field presence:
https://github.com/protocolbuffers/protobuf/blob/main/docs/f...
-
Open Source C++ Stack
This is a language-agnostic serialization library that is much faster than JSON and provides way more compact representation. There are several implementations with different features and trade offs. μpb is a very lightweight C++ implemantion that uses arena allocations.
-
A protoc compiler plugin that generates useful extension code for Kotlin/JVM
I have raised an issue requesting the addition of optional scalar types, but it is not planned to be supported by protoc-gen-kotlin.
- Show HN: Protobuf Editions now available in v27.0
-
Consistent Hashing: An Overview and Implementation in Golang
protobuf: go get -u google.golang.org/protobuf/proto
-
Hitting every branch on the way down
It's because they changed the versioning format: https://github.com/protocolbuffers/protobuf/releases?page=5
But I suppose old version still receive bugfixes.
-
Reverse Engineering Protobuf Definitions from Compiled Binaries
For at least 4 years protobuf has had decent support for self-describing messages (very similar to avro) as well as reflection
https://github.com/protocolbuffers/protobuf/blob/main/src/go...
Xgooglers trying to make do on the cheap will just create a Union of all their messages and include the message def in a self-describing message pattern. Super-sensitive network I/O can elide the message def (empty buffer) and any for RecordIO clone well file compression takes care of the definition.
Definitely useful to be able to dig out old defs but protobuf maintainers have surprisingly added useful features so you don’t have to.
Bonus points tho for extracting the protobuf defs that e.g. Apple bakes into their binaries.
What are some alternatives?
FlatBuffers - FlatBuffers: Memory Efficient Serialization Library
cereal - A C++11 library for serialization
SBE - Simple Binary Encoding (SBE) - High Performance Message Codec
Boost.Serialization - Boost.org serialization module
Apache Parquet - Apache Parquet Java
ArduinoJson - 📟 JSON library for Arduino and embedded C++. Simple and efficient.
Bond - Bond is a cross-platform framework for working with schematized data. It supports cross-language de/serialization and powerful generic mechanisms for efficiently manipulating data. Bond is broadly used at Microsoft in high scale services.
Protobuf.NET - Protocol Buffers library for idiomatic .NET