sonic
xxHash
Our great sponsors
| sonic | xxHash | |
|---|---|---|
| 23 | 2 | |
| 6,277 | 58 | |
| 3.1% | - | |
| 8.1 | 10.0 | |
| 8 days ago | over 3 years ago | |
| Assembly | Go | |
| Apache License 2.0 | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sonic
- How to Visualize and Analyze Data in Open Source Communities
-
Handling high-traffic HTTP requests with JSON payloads
Since most of the time would be spent decoding json, you could try to cut this time using https://github.com/bytedance/sonic or https://github.com/json-iterator/go, both are drop-in replacements for the stdlib, sonic is faster.
- Building a Streaming Platform in Go for Postgres
-
Building a high performance JSON parser
Also worth looking at https://github.com/bytedance/sonic
- Sonic: A fast JSON serializing and deserializing library in Go
- sonic/INTRODUCTION.md at main · bytedance/sonic
-
High-performance JSON parsing in Go
The article inside does not mention this.
-
Toward the Fastest, Compatible JSON Decoder – Sonnet
Good morning.I hope this is not the wrong place to post… so let me introduce my first public Golang package. This is a JSON decoder called Sonnet ( https://github.com/sugawarayuuta/sonnet ) that has given faster results (at least in my environment) than Sonic - https://github.com/bytedance/sonic (which is said that it's the fastest) without the help of assembly!
JSON is a very well-known file format. It is used by everyone who does programming. However, it is also not uncommon to find problems with encoding/json and other third-party libraries. for more… (see https://github.com/sugawarayuuta/sonnet#problems-we-had )
I decided to create a new, standard library-compatible decoder that would be both easy to use and fast.
Thanks for reading, feel free to use, help, or ask questions, I look forward to hearing from you. All benchmarks and other information can be found in the link at the top.
-
Toward the Fastest, Compatible JSON Decoder - Sonnet
Good morning. Let me introduce my first public Go package. This is a JSON decoder called Sonnet ( https://github.com/sugawarayuuta/sonnet ) that has given faster results (at least in my environment) than Sonic (which is said that it's the fastest) without the help of assembly!
-
Looking back on framework benchmark (updates = db writes) what can make Go improved back to be top 10?
I'd say the https://github.com/bytedance/sonic has the fastest encoder due to C and assembly optimization. (Use at your own risk.)
xxHash
-
SIMD in Go
You can find a pure go unparallelized version here : https://github.com/pierrec/xxHash
-
HaxMap, a concurrent hashmap faster and more memory-efficient than golang's sync.Map
I shall add a 32 bit variant of haxmap too in the near future using this 32 bit variant of xxHash https://github.com/pierrec/xxHash/tree/master/xxHash32
What are some alternatives?
jsoniter - Using encoding/json to load parts of a large json document
haxmap - Fastest and most memory efficient golang concurrent hashmap
fastjson - Fast JSON parser and validator for Go. No custom structs, no code generation, no reflection
hashmap - A Golang lock-free thread-safe HashMap optimized for fastest read access.
encoding - Go package containing implementations of efficient encoding, decoding, and validation APIs.
avo - Generate x86 Assembly with Go
simdjson - Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks
xxhash - A Go implementation of the 64-bit xxHash algorithm (XXH64)
simdjson-go - Golang port of simdjson: parsing gigabytes of JSON per second
go-simd - SIMD implementation in Go
json-iterator - Low level iterator on the records inside large JSON file.
intrinsics - Experiment with Go intrinsics (NOT USABLE)