json-toolkit
fq
Our great sponsors
| json-toolkit | fq | |
|---|---|---|
| 5 | 3 | |
| 67 | 281 | |
| - | 0.4% | |
| 4.6 | 0.0 | |
| about 1 year ago | over 1 year ago | |
| Python | C | |
| GNU General Public License v3.0 only | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
json-toolkit
-
Show HN: Comma Separated Values (CSV) to Unicode Separated Values (USV)
CSV is great because excel can import it, but it can't import USV, so at that point, why use USV when you can use JSON?
https://github.com/tyleradams/json-toolkit/
-
Analyzing multi-gigabyte JSON files locally
> Also note that this approach generalizes to other text-based formats. If you have 10 gigabyte of CSV, you can use Miller for processing. For binary formats, you could use fq if you can find a workable record separator.
You can also generalize it without learning a new minilanguage by using https://github.com/tyleradams/json-toolkit which converts csv/binary/whatever to/from json
- Fq: Jq for Binary Formats
-
Show HN: Angle Grinder – A terminal app to slice, dice, and aggregate your logs
I really like this tool, but I'm not sure what it gets me more than jq (and https://github.com/tyleradams/json-toolkit to convert non-json to json).
What can angle grinder do better than jq?
- Show HN: Transform a CSV into a JSON and vice versa
fq
- Fq: Jq for Binary Formats
-
Scaling Kafka at Honeycomb
Ah, https://github.com/circonus-labs/fq
It was less mature in 2016 when we made the original technology choice (and is still, I'd say, probably not a Boring Technology today). With batching, Kafka is plenty fast for us!
-
Noob question : logs centralization
I’d also be tempted by something like fq (https://github.com/circonus-labs/fq) but I’ve never run it in anger.
What are some alternatives?
miller - Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
jq - Command-line JSON processor [Moved to: https://github.com/jqlang/jq]
ndjson - Streaming line delimited json parser + serializer
faq - Format Agnostic jQ -- process various formats with libjq
angle-grinder - Slice and dice logs on the command line
Kaitai Struct - Kaitai Struct: declarative language to generate binary data parsers in C++ / C# / Go / Java / JavaScript / Lua / Nim / Perl / PHP / Python / Ruby
csv2json - Simple tool for converting CSVs to JSON
nq - Unix command line queue utility
json-logs - A tool to pretty-print JSON logs, like those from zap or logrus.
rasn - A Safe #[no_std] ASN.1 Codec Framework