fq
binary-parsing
| fq | binary-parsing | |
|---|---|---|
| 44 | 5 | |
| 9,402 | 840 | |
| - | - | |
| 9.4 | 5.7 | |
| 3 days ago | 29 days ago | |
| Go | ||
| GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fq
-
How to Use JSON Path
I feel like `fq` has a query path language that's kind of generic across lots of file types. It can be fairly verbose for that reason. I was using it to debug MsgPack documents and it was a lot less intuitive than just using some dotted string paths with `jq`.
https://github.com/wader/fq/
-
Reverse-engineering an encrypted IoT protocol
Hey! fq author here. I have a bunch of related tools in the readme https://github.com/wader/fq?tab=readme-ov-file#tools two suggestions: gnu poke and wireshark (can decode lots of more things then just network protocol)
-
To a Man with `Jq`, Everything Looks Like JSON
Did someone say let's represent structured data as json? a bit of shameless plug: https://github.com/wader/fq :) It's using a fork of gojq btw!
-
Jaq – A jq clone focused on correctness, speed, and simplicity
https://github.com/wader/fq has a REPL and can read JSON. Tip is to use "paste | from_json | repl" in a REPl to paste JSON into a sub-REPL, you can also use `` with fq which is a raw string literal
-
jq 1.7 Released
I do lots of exploratory work in various structure data, in my case often debugging media filea via https://github.com/wader/fq, which mean doing lots of use-once-queries on the command line or REPL. In those cases jq line-friendly and composable syntax and generators really shine.
- fq (jq for binary formats) has a new v0.7.0 version
- FLaNK Stack 5-June-2023
- fq: jq for binary formats - tool, language and decoders for working with binary and text formats
- Fq: Jq for Binary Formats
- GitHub - wader/fq: jq for binary formats - tool, language and decoders for working with binary and text formats
binary-parsing
- Reverse-engineering an encrypted IoT protocol
-
GNU poke: The extensible editor for structured binary data
* binary-parsing - https://github.com/dloss/binary-parsing
-
Ask HN: What software do you use to examine binary files?
There are a few hex/disk editors that support "templates" (but you need most times to create those yourself).
Here is a sort of "curated list" of related tools:
https://github.com/dloss/binary-parsing
The most complete/populated I know of is Kaitai:
http://kaitai.io/
http://formats.kaitai.io/
that you can use with Hiew with Kiewtai
https://github.com/taviso/kiewtai
If the question is slightly different, i.e. which bytes are used to identify a given file format, there is Trid:
https://mark0.net/soft-trid-e.html
Which has also a database of known headers/patterns.
- A list of tools for parsing binary data structures
-
Fq: Jq for Binary Formats
Nice! Some other tools and parsers: https://github.com/dloss/binary-parsing
What are some alternatives?
jq - Command-line JSON processor [Moved to: https://github.com/jqlang/jq]
HexFiend - A fast and clever hex editor for macOS
jq - Command-line JSON processor
Kaitai Struct - Kaitai Struct: declarative language to generate binary data parsers in C++ / C# / Go / Java / JavaScript / Lua / Nim / Perl / PHP / Python / Ruby
kaitai_struct_visualizer - Kaitai Struct: visualizer and hex viewer tool
ImHex - 🔍 A Hex Editor for Reverse Engineers, Programmers and people who value their retinas when working at 3 AM.
nq - Unix command line queue utility
json-toolkit - "the best opensource converter I've found across the Internet" -- dene14
miller - Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
unblob - Extract files from any kind of container formats