simdjson-go
jsplit
| simdjson-go | jsplit | |
|---|---|---|
| 6 | 2 | |
| 1,761 | 59 | |
| 0.7% | - | |
| 4.0 | 10.0 | |
| 6 months ago | over 1 year ago | |
| Go | Go | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
simdjson-go
-
Show HN: Up to 100x Faster FastAPI with simdjson and io_uring on Linux 5.19
Speaking of Go, there's a simdjson implementation for golang too:
> Performance wise, simdjson-go runs on average at about 40% to 60% of the speed of simdjson. Compared to Golang's standard package encoding/json, simdjson-go is about 10x faster.
I haven't tried it yet but I don't really need that speed.
https://github.com/minio/simdjson-go
-
How to Use AVX512 in Golang
I agree. For performance-sensitive situations, C/C++ or Rust is the only choice. However, many developers choose Go or other languages for engineering efficiency. A typical use case of SIMD in Go is simdjson-go. Besides, there are plenty of bindings and ports of simdjson. "Other languages" developers also need performance improvement from native instructions such as SIMD.
- Sonic: A fast JSON serializing and deserializing library
- Whats the fastest JSON unmarshaling package as of right now?
-
What is the best solution to unique data in golang
I suggest to use a streaming library to parse your file. Like jstream or simdjson-go
-
I wrote yet another json parser. It may be a contender for fastest.
You can also try comparing with https://github.com/minio/simdjson-go. It does use a different API, however, would be good to compare nevertheless.
jsplit
-
Show HN: Up to 100x Faster FastAPI with simdjson and io_uring on Linux 5.19
Regarding the hard way, this little utility does a great job of splitting larger than memory JSON documents into collections of NDJSON files:
https://github.com/dolthub/jsplit
- [OC] The ridiculously absurd amount of pricing data that insurance companies just publicly dumped
What are some alternatives?
easyjson - Fast JSON serializer for golang.
data-analysis
jstream - Streaming JSON parser for Go
JsonReader - A JSON pull parser for PHP
jsonparser - One of the fastest alternative JSON parser for Go that does not require schema
json_benchmark - Python JSON benchmarking and "correctness".
sonic - A blazingly fast JSON serializing & deserializing library
json-buffet
jsonlite - A simple, self-contained, serverless, zero-configuration, json document store.
price-transparency-guide - The technical implementation guide for the tri-departmental price transparency rule.
rjson - A fast json parser for go
msgspec - A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML