csvq
dasel
Our great sponsors
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
csvq
-
Fx – Terminal JSON Viewer
sure can do, if you already use that shell [1], but personally I like specific tools for specific jobs such as jq [2], fx, csvq [3] etc, there's value in decoupling shells from utils (modularity, speed, innovation etc).
[1] I don't but tempted to try, like its data-types concept
-
Tool to interact with CSV
csvq
-
Can SQL be used without an RDBMS?
There is a way of running SQL-like queries against CSV files.
-
Yq is a portable yq: command-line YAML, JSON, XML, CSV and properties processor
Lately I have had to do a lot of flat file analysis and tools along these lines have been a godsend. Will check this out.
My go to lately has been csvq (https://mithrandie.github.io/csvq/). Really nice to be able run complicated selects right over a CSV file with no setup at all.
-
Tool to explore big data sets
I usually do this with awk, my largest target files being half a TB in size for a project last year (and far too large to hold entirely in RAM). There are some other utilities like csvq and csvsql both of which let you write SQL-style queries against CSV files, but I'm not sure how they perform on large files. There's a nice list of CSV manipulation tools too if any of those jog your memory.
-
sqly - execute SQL against CSV / JSON with shell
Apparently, there were many who thought the same thing; Tools to execute SQL against CSV were trdsql, q, csvq, TextQL. They were highly functional, hoewver, had many options and no input completion. I found it just a little difficult to use.
- One-liner for running queries against CSV files with SQLite
-
Looking for: library to turn SQL (or abstracted) to code & execute against custom backend (slice of structs)
If you are looking to query nondb data with sql statements then you may want to check something like https://github.com/mithrandie/csvq (SQL for csv).
-
An Introduction to JQ
I just found https://github.com/mithrandie/csvq which is SQL for CSV files, which I thought was pretty cool.
dasel
- jq 1.7 Released
-
Dasel - jq for yaml json and toml
wget https://github.com/TomWright/dasel/releases/download/v2.1.2/dasel_linux_amd64 install -o root -g root -m 0755 dasel_linux_amd64 /usr/bin/dasel
-
Why a world needs an UNIX-style image collection manager?
https://github.com/TomWright/dasel handles JSON, TOML, YAML, XML and CSV
-
Tool to interact with CSV
dasel - Comparable to jq / yq, but supports JSON, YAML, TOML, XML and CSV with zero runtime dependencies.
-
Yq is a portable yq: command-line YAML, JSON, XML, CSV and properties processor
Another tool in this space is Dasel[1], which can handle querying/modifying JSON, YAML, TOML, XML and CSV files.
- Jc – JSONifies the output of many CLI tools
-
What are your coolest tools for one-liners ?
There also is dasel which combine jq, yq as well handling TOML, XML and CSV
- Run SQL on CSV, Parquet, JSON, Arrow, Unix Pipes and Google Sheet
-
What is the coolest Go open source projects you have seen?
dasel # most common human readable configs(json, yaml, xml...)
-
Implementing a simple jq clone in Go, and basics of Go memory profiling
I don't know what's up with it but I opened an issue: https://github.com/TomWright/dasel/issues/236
What are some alternatives?
jq - Command-line JSON processor [Moved to: https://github.com/jqlang/jq]
yq - Command-line YAML, XML, TOML processor - jq wrapper for YAML/XML/TOML documents
querycsv - QueryCSV enables you to load CSV files and manipulate them using SQL queries then after you finish you can export the new values to a CSV file
miller - Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
kubectl-jq - Kubectl plugin that works like "kubectl get" but runs everything through a JQ program you provide
q - q - Run SQL directly on delimited files and multi-file sqlite databases
Go Metrics - Go port of Coda Hale's Metrics library
Moby - The Moby Project - a collaborative project for the container ecosystem to assemble container-based systems
jq - Command-line JSON processor
yq - yq is a portable command-line YAML, JSON, XML, CSV, TOML and properties processor
kwatch - :eyes: monitor & detect crashes in your Kubernetes(K8s) cluster instantly