RecordStream
rq
| RecordStream | rq | |
|---|---|---|
| 3 | 10 | |
| 298 | 2,255 | |
| - | - | |
| 2.6 | 3.2 | |
| almost 4 years ago | 4 months ago | |
| Perl | Rust | |
| GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
RecordStream
-
Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON
It's interesting watching these types of tools get re-invented periodically:
https://github.com/benbernard/RecordStream
It shows the unix model of many small, composable tools is very powerful, but also shows that POSIX is missing some essential pieces that everyone keeps trying to add/reinvent.
-
Miller CLI – Like Awk, sed, cut, join, and sort for CSV, TSV and JSON
I don't know about MillerCLI's portability, but RecordStream (https://github.com/benbernard/RecordStream) is my go to swiss army knife.
-
A Lisp REPL as my main shell (article)
That record/field parsing library would be a tool to handle a broad category of command-line programs. Once the library has broken the input stream into a collection of records and fields, another layer would then turn them into internal representations. The JSON-based RecordStream tools are illustrative here: there are some tools that parse based on a delimiter or a regular expression, some that parse documented generic non-JSON formats like XML, and some that parse application-specific files like tcpdump outputs. In a Lisp world, all of the dedicated stream manipulation tools are redundant, and you avoid parsing and printing at every step in the chain.
rq
- Jc – JSONifies the output of many CLI tools
-
Shell Script Best Practices, from a decade of scripting things
Not sure what it is doing more...I'm referring to this rq: https://github.com/dflemstr/rq#format-support-status
It converts to/from the listed formats.
There is also `jc` (written in Python) with the added benefit that it converts output of many common unix utilities to json. So you would not need to parse `ip` for example.
https://github.com/kellyjonbrazil/jc
-
What debugging/monitoring method do you use? Lately, I have been using the Saleae Logic Analyzer to monitor the signals exchanged among the boards of my embedded network. I find it really cool, but do you have any other recommendations? What do you use?
In robotics most relevant signals are seen by the software. My current pattern is to log everything to MessagePack files (e.g. using mpacklog in Python or palimpsest in C++), then dump and plot the data later on using handy command-line tools like jq and rq.
- Tombl – Easily query .toml files from bash
- rq: Universal convertor between structured data (JSON, MessagePack, CBOR, etc.)
- Show HN: utt, the Universal Text Transformer
- FX: An interactive alternative to jq to process JSON
- Tips on Adding JSON Output to Your CLI App
-
Miller CLI – Like Awk, sed, cut, join, and sort for CSV, TSV and JSON
There's also rq (record query)[1] that also supports CSV and JSON but not TSV though. It's written in Rust.
[1] https://github.com/dflemstr/rq
-
What's everyone working on this week (27/2021)?
Ish. https://github.com/dflemstr/rq/ It removed its processing language a while ago. It's still a very useful tool, though. Imho, it's a bigger pity that it can't highlight YAML on output, or parse YAML 1.1.
What are some alternatives?
ocaml-containers - A lightweight, modular standard library extension, string library, and interfaces to various libraries (unix, threads, etc.) BSD license.
fx - Terminal JSON viewer & processor
vnlog - Process labelled tabular ASCII data using normal UNIX tools
if-decompiler - Decompile Glulx storyfiles into C code
DataProfiler - What's in your data? Extract schema, statistics and entities from datasets
jiq - jid on jq - interactive JSON query tool using jq expressions
jq - Command-line JSON processor [Moved to: https://github.com/jqlang/jq]
hello-actix - Hello, actix!
miller - Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
jq - Command-line JSON processor
dprint - Pluggable and configurable code formatting platform written in Rust.