msgpack
Protobuf
| msgpack | Protobuf | |
|---|---|---|
| 5 | 183 | |
| 6,983 | 65,431 | |
| 0.7% | 0.6% | |
| 0.0 | 10.0 | |
| 2 months ago | 3 days ago | |
| C++ | ||
| - | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
msgpack
- SQLite needs testers for the new binary JSON format
-
Salt Exporter: the story behind the tool
I also read that Salt was using MessagePack to format their messages. MessagePack is a format like JSON, but more compact.
- Add extra stuff to a “standard” encoding? Sure, why not
- MessagePack: It's like JSON, but fast and small
-
mus-go - the fastest Golang serializer today
Sorry, but I don't think it looks like MessagePack. I wonder why you think so? MUS format does not contain a data types, unlike MessagePack. So, for example, the uint8 type in MessagePack can be encoded with two bytes (from the MessagePack specification): uint 8 stores a 8-bit unsigned integer +--------+--------+ | 0xcc |ZZZZZZZZ| +--------+--------+ The same data type in MUS format is encoded with just one byte. This fact alone is quite a significant difference.
Protobuf
- What's new in C++26 (part 1)
-
Why should we use Protobuf in Web API as data transfer protocol.
Note: If you want to use the Google Protobuf compiler for code generation, download it from GitHub based on your OS. Follow this link for code generation instructions.
-
Another variable-length integer encoding
Unary length prefix is a solid technique. I would be careful with the performance claims, though. Sometimes what the machine can do is surprising and the performance of a system that looks like it needs to loop and branch is faster than you expected. The protobuf project, unsurprisingly for a project of its age, has several different varint parsing strategies. One is described at https://github.com/protocolbuffers/protobuf/blob/main/src/go... and another at https://github.com/protocolbuffers/protobuf/blob/main/src/go...
-
Parsing Protobuf Definitions with Tree-sitter
See protobuf field presence:
https://github.com/protocolbuffers/protobuf/blob/main/docs/f...
-
Open Source C++ Stack
This is a language-agnostic serialization library that is much faster than JSON and provides way more compact representation. There are several implementations with different features and trade offs. μpb is a very lightweight C++ implemantion that uses arena allocations.
-
A protoc compiler plugin that generates useful extension code for Kotlin/JVM
I have raised an issue requesting the addition of optional scalar types, but it is not planned to be supported by protoc-gen-kotlin.
- Show HN: Protobuf Editions now available in v27.0
-
Consistent Hashing: An Overview and Implementation in Golang
protobuf: go get -u google.golang.org/protobuf/proto
-
Hitting every branch on the way down
It's because they changed the versioning format: https://github.com/protocolbuffers/protobuf/releases?page=5
But I suppose old version still receive bugfixes.
-
Reverse Engineering Protobuf Definitions from Compiled Binaries
For at least 4 years protobuf has had decent support for self-describing messages (very similar to avro) as well as reflection
https://github.com/protocolbuffers/protobuf/blob/main/src/go...
Xgooglers trying to make do on the cheap will just create a Union of all their messages and include the message def in a self-describing message pattern. Super-sensitive network I/O can elide the message def (empty buffer) and any for RecordIO clone well file compression takes care of the definition.
Definitely useful to be able to dig out old defs but protobuf maintainers have surprisingly added useful features so you don’t have to.
Bonus points tho for extracting the protobuf defs that e.g. Apple bakes into their binaries.
What are some alternatives?
salt-exporter - Salt Prometheus exporter working out of the box without any configuration on Salt side. Comes with an event watcher TUI.
FlatBuffers - FlatBuffers: Memory Efficient Serialization Library
protobuf-conformance - A repository running the Protobuf conformance tests against various libraries
SBE - Simple Binary Encoding (SBE) - High Performance Message Codec
mqtt-exporter - Simple generic MQTT Prometheus exporter for IoT working out of the box
MessagePack - MessagePack implementation for C and C++ / msgpack.org[C/C++]
go-client - Nvim Go client
cereal - A C++11 library for serialization
riegeli - Riegeli/records is a file format for storing a sequence of string records, typically serialized protocol buffers.
Apache Parquet - Apache Parquet Java
zoa - serialized structured data and it's textual representation
Bond - Bond is a cross-platform framework for working with schematized data. It supports cross-language de/serialization and powerful generic mechanisms for efficiently manipulating data. Bond is broadly used at Microsoft in high scale services.