vnlog
Process labelled tabular ASCII data using normal UNIX tools (by dkogan)
rq
Record Query - A tool for doing record analysis and transformation (by dflemstr)
Our great sponsors
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
vnlog
Posts with mentions or reviews of vnlog.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-22.
- Vnlog: Process labelled tabular ASCII data using normal Unix tools
- Process tabular data with Unix tools
-
Qsv: Efficient CSV CLI Toolkit
For simple analyses (i.e. what most people do most of the time) doing this on the commandline gets you there faster. I use vnlog (https://github.com/dkogan/vnlog/). By the time you fired up your editor to write your Python code, I already have analyses and plots ready.
-
Joining CSV Data Without SQL: An IP Geolocation Use Case
Alternative very appropriate for some uses cases: `vnl-join` from the vnlog toolkit (https://github.com/dkogan/vnlog). Uses the `join` tool from coreutils (works well, has been around forever), and `vnlog` for nice column labelling
-
Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON
There's also https://github.com/dkogan/vnlog/ which is a wrapper around the existing coreutils, so all the options work, and there's nothing to learn
- vnlog: making awk and sort and join (and friends) smarter
-
Awk equivalents to SQL query data manipulation
And to improve the ergonomics, the vnlog wrappers are available to operate on field names, while retaining the internals of the core tools:
https://github.com/dkogan/vnlog/ - Vnlog: Making Awk, grep, sort and join smarter
-
Learn to Process Text in Linux Using Grep, Sed, and Awk
I sorta, kinda agree. Tools written in AWK (and friends) are indeed somewhat unmaintainable, but they're really close to being just right for a LOT of applications. The vnlog toolkit (https://github.com/dkogan/vnlog) adds just a little bit of syntactic sugar to the usual commandline tools to make processing scripts robust and easy to read and write. This was not my intent initially, but I now do most of my data processing with the shell and vnl-wrapped awk (and sort and join, ...) It's really nice. If you write stuff in awk, you should check it out. (Disclaimer: I'm the author)
- Extending Awk with Field Labels
rq
Posts with mentions or reviews of rq.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-11-03.
- Jc – JSONifies the output of many CLI tools
-
Shell Script Best Practices, from a decade of scripting things
Not sure what it is doing more...I'm referring to this rq: https://github.com/dflemstr/rq#format-support-status
It converts to/from the listed formats.
There is also `jc` (written in Python) with the added benefit that it converts output of many common unix utilities to json. So you would not need to parse `ip` for example.
https://github.com/kellyjonbrazil/jc
-
What debugging/monitoring method do you use? Lately, I have been using the Saleae Logic Analyzer to monitor the signals exchanged among the boards of my embedded network. I find it really cool, but do you have any other recommendations? What do you use?
In robotics most relevant signals are seen by the software. My current pattern is to log everything to MessagePack files (e.g. using mpacklog in Python or palimpsest in C++), then dump and plot the data later on using handy command-line tools like jq and rq.
- Tombl – Easily query .toml files from bash
- rq: Universal convertor between structured data (JSON, MessagePack, CBOR, etc.)
- Show HN: utt, the Universal Text Transformer
- FX: An interactive alternative to jq to process JSON
- Tips on Adding JSON Output to Your CLI App
-
Miller CLI – Like Awk, sed, cut, join, and sort for CSV, TSV and JSON
There's also rq (record query)[1] that also supports CSV and JSON but not TSV though. It's written in Rust.
[1] https://github.com/dflemstr/rq
-
What's everyone working on this week (27/2021)?
Ish. https://github.com/dflemstr/rq/ It removed its processing language a while ago. It's still a very useful tool, though. Imho, it's a bigger pity that it can't highlight YAML on output, or parse YAML 1.1.
What are some alternatives?
When comparing vnlog and rq you can also consider the following projects:
ttyplot - a realtime plotting utility for terminal/console with data input from stdin
fx - Terminal JSON viewer & processor
matplotplusplus - Matplot++: A C++ Graphics Library for Data Visualization 📊🗾
if-decompiler - Decompile Glulx storyfiles into C code
RecordStream - commandline tools for slicing and dicing JSON records.
jiq - jid on jq - interactive JSON query tool using jq expressions
nvim-ipy - IPython/Jupyter plugin for Neovim
hello-actix - Hello, actix!
jupytext.vim - Vim plugin for editing Jupyter ipynb files via jupytext
jq - Command-line JSON processor [Moved to: https://github.com/jqlang/jq]
matplotlib - C++ wrappers around python's matplotlib
dprint - Pluggable and configurable code formatting platform written in Rust.