GJSON
jsonparser
GJSON | jsonparser | |
---|---|---|
34 | 15 | |
13,636 | 5,355 | |
- | - | |
5.1 | 0.0 | |
11 days ago | about 2 months ago | |
Go | Go | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
GJSON
-
Rob Pike: Gobs of data (2011)
Someone made a benchmark of serialization libraries in go [1], and I was surprised to see gobs is one of the slowest ones, specially for decoding. I suspect part of the reason is that the API doesn't not allow reusing decoders [2]. From my explorations it seems like both JSON [3], message-pack [4] and CBOR [5] are better alternatives.
By the way, in Go there are a like a million JSON encoders because a lot of things in the std library are not really coded for maximum performance but more for easy of usage, it seems. Perhaps this is the right balance for certain things (ex: the http library, see [6]).
There are also a bunch of libraries that allow you to modify a JSON file "in place", without having to fully deserialize into structs (ex: GJSON/SJSON [7] [8]). This sounds very convenient and more efficient that fully de/serializing if we just need to change the data a little.
--
1: https://github.com/alecthomas/go_serialization_benchmarks
2: https://github.com/golang/go/issues/29766#issuecomment-45492...
--
3: https://github.com/goccy/go-json
4: https://github.com/vmihailenco/msgpack
5: https://github.com/fxamacker/cbor
--
6: https://github.com/valyala/fasthttp#faq
--
7: https://github.com/tidwall/gjson
8: https://github.com/tidwall/sjson
-
Jj: JSON Stream Editor
```
I don't think there is a way to sort an array, though. However, there is an option to have keys sorted. Personally, I don't think there is much annoyance in that. One could just pipe `jj` output to `sort | uniq -c`.
[0]: https://github.com/tidwall/gjson/blob/master/SYNTAX.md
-
Library to analyze an arbitrary JSON string
I’m using GJSON, so far so good!
-
Mapping json fields in api calls to a struct to store them in a database or cache
If the fields you need are just a small subset of the whole json, maybe https://github.com/tidwall/gjson might be of use to read only those (using jsonpath) without needing to create complete corresponding structs.
-
Which CPU to buy based on profiling
Thank you for the reminder, it's never too much of it :) Didn't say it, but the code was pprof-iled many times and i can really say it's well optimized. I use own libraries with on-the-fly equations (sums, avgs, emas, stds, ...) wherever possible and also made custom json parser as json messages are in fixed format, so the parser is about 10x faster than gjson. I optimized it to the point that I avoided using maps, and rather iterate via slice where ever possible.
-
Jetro - transform and query JSON format
You are right, for learning purposes this fit my needs, but I can imagine an approach similar to this repo: https://github.com/tidwall/gjson
-
Any way to convert unknown/dynamic json to generic object structure
https://github.com/tidwall/gjson is a relatively sensible library if this is something you need to deal with and the structure is actually unknowable.
- Need help with getting the grandchild in nested JSON
- Double down on python or learn Go
- Ad hoc JSON parsing
jsonparser
-
Introducing astjson: Transform and Merge JSON Objects with Unmatched Speed in Go
In this article, I will introduce you to a new package called astjson that I have been working on for the last couple of weeks. It is a Go package that allows you to transform and merge JSON objects with unmatched speed. It is based on the jsonparser package by buger aka Leonid Bugaev and extends it with the ability to transform and merge JSON objects at unparalleled performance.
-
What's the best way to unmarshall this nested JSON?
Use this to extract the data value, and handle/unmarshal it accordingly.
- Modification of json string without deserialisation into map/struct
- Christmas giveaway: 10 copies of my book Domain-driven Design with Golang book, also AMA
-
Wasm difficulties in Rust, Haskell, and Go
jsonparser can decode, but can't encode
-
Is there a way to parse unstructured data?
Best I've found is this: https://github.com/buger/jsonparser
-
Why the heck am I getting an empty byte array trying to read a simple json file?
I was actually just trying to get it into a []byte to use this package which claims it works well for unknown data structures.
-
Zq: An Easier (and Faster) Alternative to Jq
`jj` is a little tool I wrote that uses https://github.com/buger/jsonparser
-
Whats the fastest JSON unmarshaling package as of right now?
If you don't know the schema or you only need to access one or two fields in a much larger JSON object, I would recommend https://github.com/buger/jsonparser as it provides an easy API to access specific values without fully unmarshaling. This is an unusual use case though, 9 times out of 10 I would tend to use easyjson.
-
map[string]interface{} decoder
Reading and navigating arbitrary JSON: I've used https://github.com/tidwall/gjson, many others like https://github.com/buger/jsonparser are also out there.
What are some alternatives?
jsoniter - A high-performance 100% compatible drop-in replacement of "encoding/json"
fastjson - Fast JSON parser and validator for Go. No custom structs, no code generation, no reflection
go-json - Fast JSON encoder/decoder compatible with encoding/json for Go
ej - Write and read JSON from different sources in one line
intrinsic
mapslice-json - Go MapSlice for ordered marshal/ unmarshal of maps in JSON
gojson - Automatically generate Go (golang) struct definitions from example JSON
ojg - Optimized JSON for Go
hub - A command-line tool that makes git easier to use with GitHub.
json-to-proto.github.io - convert JSON to Protocol Buffers online in your browser instantly
ngrok - Unified ingress for developers
jsondiff - Compute the diff between two JSON documents as a series of RFC6902 (JSON Patch) operations