yq
csvq
Our great sponsors
yq | csvq | |
---|---|---|
24 | 14 | |
2,461 | 1,446 | |
- | - | |
6.1 | 2.7 | |
6 days ago | 4 months ago | |
Python | Go | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
yq
- Jaq – A jq clone focused on correctness, speed, and simplicity
- jq 1.7 Released
- Using XPath in 2023
-
How to troubleshoot yaml parsing error "did not find expected key"?
Install jq and yq, and wrap your commands with | yq -y ..
-
Memes are all cool and all. But this is your daily remaining that 10000! =
Confusingly there is another project called yq that does exactly what you're suggesting and it's a preprocessor that converts yaml to json and then used jq. https://github.com/kislyuk/yq
-
inhumane and error-prone
yq
-
Yq is a portable yq: command-line YAML, JSON, XML, CSV and properties processor
I personally find the yq tool from https://github.com/kislyuk/yq much more useful: it has all the same options and formats as `jq` (as it's really a wrapper around jq). Rather than the `yq` in the OP here where only partial functionality exists.
- The YAML Document from Hell
-
Scraping weather info
XML data from the API can be parsed and filtered with xq. There may be multiple ways to get it; first try the yq toolset which includes it.
-
Show HN: Xq – command-line XML and HTML beautifier and content extractor
There is also yq [1], which attempts the same for yaml, toml and xml. (And confusingly also contains a binary named "xq" for querying xml, however with a different syntax)
[1] https://github.com/kislyuk/yq
csvq
-
Fx – Terminal JSON Viewer
sure can do, if you already use that shell [1], but personally I like specific tools for specific jobs such as jq [2], fx, csvq [3] etc, there's value in decoupling shells from utils (modularity, speed, innovation etc).
[1] I don't but tempted to try, like its data-types concept
[2] https://jqlang.github.io/jq/
[3] https://github.com/mithrandie/csvq
-
Tool to interact with CSV
csvq
-
Can SQL be used without an RDBMS?
There is a way of running SQL-like queries against CSV files.
-
Yq is a portable yq: command-line YAML, JSON, XML, CSV and properties processor
Lately I have had to do a lot of flat file analysis and tools along these lines have been a godsend. Will check this out.
My go to lately has been csvq (https://mithrandie.github.io/csvq/). Really nice to be able run complicated selects right over a CSV file with no setup at all.
-
Wie fusioniert man CSV tables?
csvq (https://mithrandie.github.io/csvq/)
-
Tool to explore big data sets
I usually do this with awk, my largest target files being half a TB in size for a project last year (and far too large to hold entirely in RAM). There are some other utilities like csvq and csvsql both of which let you write SQL-style queries against CSV files, but I'm not sure how they perform on large files. There's a nice list of CSV manipulation tools too if any of those jog your memory.
-
sqly - execute SQL against CSV / JSON with shell
Apparently, there were many who thought the same thing; Tools to execute SQL against CSV were trdsql, q, csvq, TextQL. They were highly functional, hoewver, had many options and no input completion. I found it just a little difficult to use.
- One-liner for running queries against CSV files with SQLite
-
Most efficient way to query .CSV files for Mac?
Please check out this tool https://github.com/mithrandie/csvq
-
Looking for: library to turn SQL (or abstracted) to code & execute against custom backend (slice of structs)
If you are looking to query nondb data with sql statements then you may want to check something like https://github.com/mithrandie/csvq (SQL for csv).
What are some alternatives?
jq - Command-line JSON processor [Moved to: https://github.com/jqlang/jq]
querycsv - QueryCSV enables you to load CSV files and manipulate them using SQL queries then after you finish you can export the new values to a CSV file
yq - yq is a portable command-line YAML, JSON, XML, CSV, TOML and properties processor
q - q - Run SQL directly on delimited files and multi-file sqlite databases
jq - Command-line JSON processor
dasel - Select, put and delete data from JSON, TOML, YAML, XML and CSV files with a single tool. Supports conversion between formats and can be used as a Go package.
duckdb - DuckDB is an in-process SQL OLAP Database Management System
xmlq - filter xml in the command line with xpath
gsheet - gsheet is a CLI tool (and Golang package) for piping csv data to and from Google Sheets
hn-search - Hacker News Search
miller - Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON