Fq: Jq for Binary Formats

• fq

  45 9,417 9.4 Go

  jq for binary formats - tool, language and decoders for working with binary and text formats

Hi! yes it's kind of support but in a very go:ish at the moment. You can use fq as submodule, import/register your own format decoders and then run cli.Main. More or less what https://github.com/wader/fq/blob/master/fq.go does.

• faq

  2 419 0.0 Go

  Format Agnostic jQ -- process various formats with libjq

This related project, on the other hand, embraced it (for better or for worse):

https://github.com/jzelinskie/faq

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Kaitai Struct

  44 3,844 7.5 Shell

  Kaitai Struct: declarative language to generate binary data parsers in C++ / C# / Go / Java / JavaScript / Lua / Nim / Perl / PHP / Python / Ruby

  

• HexFiend

  10 5,178 9.1 Objective-C

  A fast and clever hex editor for macOS

  

• binspector

  4 225 1.8 C++

  A binary format analysis tool

  

• json-logs

  4 14 0.0 Go

  A tool to pretty-print JSON logs, like those from zap or logrus.

I wrote a small script to convert CSVs to JSON strictly to use jq on the output. Querying things like your GCP bill with jq is quite enjoyable.

gojq is also nice. I work with a lot of structured logs and wrapped jq with a little bit of format-understanding and output sugar to make looking at and analyzing such logs an enjoyable experience: https://github.com/jrockway/json-logs

• nq

  18 2,779 2.5 C

  Unix command line queue utility

Interesting project. Unfortunate that its name conflicts with one of nq’s executables (https://github.com/leahneukirchen/nq), but I’m not sure anything can be done about it.

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• fq

  3 281 0.0 C

  F@#$*&%Q (Message queue that is fast, brokered, in C and gets out of your way) (by circonus-labs)

  

• jq

  306 25,063 0.0 C

  Discontinued Command-line JSON processor [Moved to: https://github.com/jqlang/jq] (by stedolan)

  

> I wrote a small script to convert CSVs to JSON strictly to use jq on the output

Note that you can use jq to consume simple CSVs (and produce them) without anything else. There’s an entry in the cookbook wiki https://github.com/stedolan/jq/wiki/Cookbook#convert-a-csv-f... - I posted some usage examples a few months back https://news.ycombinator.com/item?id=27379423

• miller

  63 8,571 9.0 Go

  Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

Miller Csv can process json in record format and has a much saner DSL in my experience.

https://github.com/johnkerl/miller

• binary-parsing

  5 842 5.7

  A list of generic tools for parsing binary data structures, such as file formats, network protocols or bitstreams

Nice! Some other tools and parsers: https://github.com/dloss/binary-parsing

• gojq

  3 3 8.4 Go

  Pure Go implementation of jq (by wader)

For query language i didn't prototype much, i know i really wanted jq as i had already used it extensively and know it was very powerful and had a terse syntax when working with structured data. I had some ideas of maybe using the C-version of jq via bindings or somehow let fq be tool that you used like this 'fq file | jq ... | fq' but it just felt strange and not very user friendly. Then i found gojq and i just felt that i have to make it work somehow, even if it would require lots of hard work and change to it (see https://github.com/wader/gojq/commits/fq, the JQValue change it probably to most interesting and support or custom iterators/functions that has been merged). And it turned out much better than i would expected, large parts becuse gojq's code is very nice and author has been very helpful.

• json-toolkit

  5 67 4.6 Python

  "the best opensource converter I've found across the Internet" -- dene14

• rasn

  8 175 8.6 Rust

  A Safe #[no_std] ASN.1 Codec Framework

  

Shameless plug, but you may be interested in my library (which is MIT/Apache-2.0) that offers decoding from BER/DER/CER all from a single model in code, there's no UPER/APER support at the moment, but it's coming in the next few months. :)

https://github.com/XAMPPRocky/rasn

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project