csvq
gsheet
Our great sponsors
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
csvq
-
Fx – Terminal JSON Viewer
sure can do, if you already use that shell [1], but personally I like specific tools for specific jobs such as jq [2], fx, csvq [3] etc, there's value in decoupling shells from utils (modularity, speed, innovation etc).
[1] I don't but tempted to try, like its data-types concept
-
Tool to interact with CSV
csvq
-
Can SQL be used without an RDBMS?
There is a way of running SQL-like queries against CSV files.
-
Yq is a portable yq: command-line YAML, JSON, XML, CSV and properties processor
Lately I have had to do a lot of flat file analysis and tools along these lines have been a godsend. Will check this out.
My go to lately has been csvq (https://mithrandie.github.io/csvq/). Really nice to be able run complicated selects right over a CSV file with no setup at all.
-
Wie fusioniert man CSV tables?
csvq (https://mithrandie.github.io/csvq/)
-
Tool to explore big data sets
I usually do this with awk, my largest target files being half a TB in size for a project last year (and far too large to hold entirely in RAM). There are some other utilities like csvq and csvsql both of which let you write SQL-style queries against CSV files, but I'm not sure how they perform on large files. There's a nice list of CSV manipulation tools too if any of those jog your memory.
-
sqly - execute SQL against CSV / JSON with shell
Apparently, there were many who thought the same thing; Tools to execute SQL against CSV were trdsql, q, csvq, TextQL. They were highly functional, hoewver, had many options and no input completion. I found it just a little difficult to use.
- One-liner for running queries against CSV files with SQLite
-
Most efficient way to query .CSV files for Mac?
Please check out this tool https://github.com/mithrandie/csvq
-
Looking for: library to turn SQL (or abstracted) to code & execute against custom backend (slice of structs)
If you are looking to query nondb data with sql statements then you may want to check something like https://github.com/mithrandie/csvq (SQL for csv).
gsheet
-
Query Google Sheets as virtual tables with SQLite extension – libgsqlite
I wrote a little cli[1] that is a bit easier than curl for getting data to and from google sheets as csv. I do think this sqlite extension would be even more convenient if it supported writing data with INSERT/UPDATE.
-
googlesheetsparser - a library for dynamically parsing google sheets into golang structs
I maintain several Go programs that mostly just copy data from google sheets, process it, then upload it back to a google sheet. My current approach is to parse the sheets as CSV, then serialize it back as CSV (I'm the author of cristoper/gsheet), but the idea of parsing it directly to Go structs is interesting.
- gsheet is a CLI tool (and Golang package) for piping csv data to and from Google Sheets
- gsheet is a cli tool for piping csv data to and from Google Sheets
What are some alternatives?
querycsv - QueryCSV enables you to load CSV files and manipulate them using SQL queries then after you finish you can export the new values to a CSV file
trdsql - CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats.
q - q - Run SQL directly on delimited files and multi-file sqlite databases
octosql - OctoSQL is a query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL.
yq - yq is a portable command-line YAML, JSON, XML, CSV, TOML and properties processor
dataconnector - Connect to any API, website or database in Google Sheets.
yq - Command-line YAML, XML, TOML processor - jq wrapper for YAML/XML/TOML documents
drive - Google Drive client for the commandline
duckdb - DuckDB is an in-process SQL OLAP Database Management System
rclone - "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files
miller - Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
googlesheetsparser - googlesheetsparser is a library for dynamically parsing Google Sheets into Golang structs.