-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
simdjson
Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks
This blog post was written by an Eastern European so I'm afraid you'll have to find another ethnicity to blame for Rockstar's failures.
Looks like it has a reason: https://github.com/huangqinjin/ucrt/blob/a52376780e631fb0e5d520748addb03651aef0b5/stdio/input.cpp#L95-L98
I don't think JSON is really the problem - parsing 10MB of JSON is not so slow. For example, using Python's json.load takes about 800ms for a 47MB file on my system, using something like simdjson cuts that down to ~70ms.
I have never heard of its existence before but after just reading the GitHub page of simdjson and the statistics they provide (2.5GB/s) I wonder why it isn't the standard
I don't see why something like Jansson wouldn't.
That profiling method 😬 someone please tell them about UIforETW