jsplit
simdjson-go
| jsplit | simdjson-go | |
|---|---|---|
| 2 | 6 | |
| 59 | 1,764 | |
| - | 0.9% | |
| 10.0 | 4.0 | |
| over 1 year ago | 6 months ago | |
| Go | Go | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
jsplit
-
Show HN: Up to 100x Faster FastAPI with simdjson and io_uring on Linux 5.19
Regarding the hard way, this little utility does a great job of splitting larger than memory JSON documents into collections of NDJSON files:
https://github.com/dolthub/jsplit
- [OC] The ridiculously absurd amount of pricing data that insurance companies just publicly dumped
simdjson-go
-
Show HN: Up to 100x Faster FastAPI with simdjson and io_uring on Linux 5.19
Speaking of Go, there's a simdjson implementation for golang too:
> Performance wise, simdjson-go runs on average at about 40% to 60% of the speed of simdjson. Compared to Golang's standard package encoding/json, simdjson-go is about 10x faster.
I haven't tried it yet but I don't really need that speed.
https://github.com/minio/simdjson-go
-
How to Use AVX512 in Golang
I agree. For performance-sensitive situations, C/C++ or Rust is the only choice. However, many developers choose Go or other languages for engineering efficiency. A typical use case of SIMD in Go is simdjson-go. Besides, there are plenty of bindings and ports of simdjson. "Other languages" developers also need performance improvement from native instructions such as SIMD.
- Sonic: A fast JSON serializing and deserializing library
- Whats the fastest JSON unmarshaling package as of right now?
-
What is the best solution to unique data in golang
I suggest to use a streaming library to parse your file. Like jstream or simdjson-go
-
I wrote yet another json parser. It may be a contender for fastest.
You can also try comparing with https://github.com/minio/simdjson-go. It does use a different API, however, would be good to compare nevertheless.
What are some alternatives?
data-analysis
easyjson - Fast JSON serializer for golang.
JsonReader - A JSON pull parser for PHP
jstream - Streaming JSON parser for Go
json_benchmark - Python JSON benchmarking and "correctness".
jsonparser - One of the fastest alternative JSON parser for Go that does not require schema
json-buffet
sonic - A blazingly fast JSON serializing & deserializing library
price-transparency-guide - The technical implementation guide for the tri-departmental price transparency rule.
jsonlite - A simple, self-contained, serverless, zero-configuration, json document store.
msgspec - A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML
rjson - A fast json parser for go