jaq
miller
Our great sponsors
| jaq | miller | |
|---|---|---|
| 24 | 63 | |
| 2,458 | 8,542 | |
| - | - | |
| 9.6 | 9.1 | |
| 5 days ago | 4 days ago | |
| Rust | Go | |
| MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
jaq
-
Jaq – A jq clone focused on correctness, speed, and simplicity
https://github.com/01mf02/jaq/blob/main/Cargo.lock
That's a lot of dependencies..
-
Interactive Examples for Learning Jq
Thanks for the jqjq shoutout! :) i'm quite sure jq is turing complete, jq (and jqjq!) can implement brainfuck https://github.com/01mf02/jaq/blob/main/examples/bf.jq
-
This is a very old theme, solved by Pike and Kernigan since 1984, in section 5.5 (Replacing a file: overwrite), page 155 in the book
/uj Because of this post, I have learned I could have been using jaq instead of jq.
-
A new major version of jql has been released
There's also jaq which is written in Rust, aims for compatibility with jq (except some specific features), and boasts better performance.
-
Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON
I've been getting a lot of mileage out of https://github.com/itchyny/gojq#readme recently due to two things: its vastly superior error messages and the (regrettably verbose) `--yaml-input` option
I also have https://github.com/01mf02/jaq#readme installed but just haven't needed it
-
why GNU grep is fast
For lightly structured data, nushell (still pre-release) or jq/jaq are better.
-
Surprises in the Rust JSON Ecosystem
Just yesterday, I started work on replacing serde_json in my project jaq by hifijson, which cut JSON loading time in half! The downside of hifijson is that documentation is still TODO. But I intend to work on this as soon as I have a prototype of jaq with hifijson working.
-
Jq Internals: Backtracking
I hear you, but OTOH in this thread are two alternative implementations, one which seems especially focused on "bolt tightening" some of the edge cases: https://github.com/01mf02/jaq#assignments
Isn't the adage to only build a framework after the 3rd or 4th implementation? That seems to apply to writing a RFC, also
miller
- Qsv: Efficient CSV CLI Toolkit
-
jq 1.7 Released
jq and miller[1] are essential parts of my toolbelt, right up there with awk and vim.
-
Perl first commit: a “replacement” for Awk and sed
> This works really well if your problem can be solved in one or two liners.
My personal comfort threshold is around the 100-line mark. It's even possible to write maintainable shell scripts up to 500 lines, but it mostly depends on the problem you're trying to solve, and the discipline of the programmer to follow best practices (use sane defaults, ShellCheck, etc.).
> It go bad very quickly when, say, you have two CSV files and want to join them the sql-way.
In that case we're talking about structured data, and, yeah, Perl or Python would be easier to work with. That said, depending on the complexity of the CSV, you can still go a long way with plain Bash with IFS/read(1) or tr(1) to split CSV columns. This wouldn't be very robust, but there are tools that handle CSV specifically[1], which can be composed in a shell script just fine.
So it's always a balancing act of being productive quickly with a shell script, or reaching out for a programming language once the tools aren't a good fit, or maintenance becomes an issue.
-
GQL: A new SQL like query language for .git files written in Rust
That said, you may be interested in Miller (https://github.com/johnkerl/miller) which provides similar capabilities for CSV, JSON, and XML files. It doesn't use a SQL grammar, but that's just the proverbial lipstick on the thing. I'm not the author, but I have used it and I see some parallels in use cases at the very least.
-
Any cli utility to create ascii/org mode tables?
worth giving Miller a shot
-
I wrote this iCalendar (.ics) command-line utility to turn common calendar exports into more broadly compatible CSV files.
CSV utilities (still haven't pick a favorite one...): https://github.com/harelba/q https://github.com/BurntSushi/xsv https://github.com/wireservice/csvkit https://github.com/johnkerl/miller
- Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON
- Nushell.sh ls – where size > 10mb – –sort-by modified
-
Tool to interact with CSV
Came here to recommend miller!
What are some alternatives?
visidata - A terminal spreadsheet multitool for discovering and arranging data
xsv - A fast CSV command line toolkit written in Rust.
jq - Command-line JSON processor [Moved to: https://github.com/jqlang/jq]
dasel - Select, put and delete data from JSON, TOML, YAML, XML and CSV files with a single tool. Supports conversion between formats and can be used as a Go package.
csvtk - A cross-platform, efficient and practical CSV/TSV toolkit in Golang
yq - yq is a portable command-line YAML, JSON, XML, CSV, TOML and properties processor
csvq - SQL-like query language for csv
json-toolkit - "the best opensource converter I've found across the Internet" -- dene14
gron - Make JSON greppable!
csvkit - A suite of utilities for converting to and working with CSV, the king of tabular file formats.
awesome-cli-apps - 🖥 📊 🕹 🛠 A curated list of command line apps
nushell - A new type of shell