binstruct
cbor
Our great sponsors
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
binstruct
We haven't tracked posts mentioning binstruct yet.
Tracking mentions began in Dec 2020.
cbor
-
Rob Pike: Gobs of data (2011)
Someone made a benchmark of serialization libraries in go [1], and I was surprised to see gobs is one of the slowest ones, specially for decoding. I suspect part of the reason is that the API doesn't not allow reusing decoders [2]. From my explorations it seems like both JSON [3], message-pack [4] and CBOR [5] are better alternatives.
By the way, in Go there are a like a million JSON encoders because a lot of things in the std library are not really coded for maximum performance but more for easy of usage, it seems. Perhaps this is the right balance for certain things (ex: the http library, see [6]).
There are also a bunch of libraries that allow you to modify a JSON file "in place", without having to fully deserialize into structs (ex: GJSON/SJSON [7] [8]). This sounds very convenient and more efficient that fully de/serializing if we just need to change the data a little.
--
1: https://github.com/alecthomas/go_serialization_benchmarks
2: https://github.com/golang/go/issues/29766#issuecomment-45492...
--
3: https://github.com/goccy/go-json
4: https://github.com/vmihailenco/msgpack
5: https://github.com/fxamacker/cbor
--
6: https://github.com/valyala/fasthttp#faq
--
-
What is the fastest way to encode the arbitrary struct into bytes?
Ha, no suggestions for cbor https://github.com/fxamacker/cbor
- How can we umarshal a Big JSON effectively?
-
80x improvements in caching by moving from JSON to gob
If you need to support non-Go code I suggest you explore CBOR. There are a few implementations in Go but his is my favorite.
What are some alternatives?
go-codec - idiomatic codec and rpc lib for msgpack, cbor, json, etc. msgpack.org[Go]
asn1
csvutil - csvutil provides fast and idiomatic mapping between CSV and Go (golang) values.
goprotobuf - Go support for Google's protocol buffers
gogoprotobuf - [Deprecated] Protocol Buffers for Go with Gadgets
fwencoder - Fixed width file parser (encoder/decoder) in GO (golang)
go-capnproto - Cap'n Proto library and parser for go. This is go-capnproto-1.0, and does not have rpc. See https://github.com/zombiezen/go-capnproto2 for 2.0 which has rpc and capabilities.
mapstructure - Go library for decoding generic map values into native Go structures and vice versa.
bambam - auto-generate capnproto schema from your golang source files. Depends on go-capnproto-1.0 at https://github.com/glycerine/go-capnproto
jsoniter - A high-performance 100% compatible drop-in replacement of "encoding/json"