csvq
csvkit
csvq | csvkit | |
---|---|---|
14 | 9 | |
1,450 | 5,821 | |
- | 0.5% | |
2.7 | 8.6 | |
5 months ago | 6 days ago | |
Go | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
csvq
-
Fx – Terminal JSON Viewer
sure can do, if you already use that shell [1], but personally I like specific tools for specific jobs such as jq [2], fx, csvq [3] etc, there's value in decoupling shells from utils (modularity, speed, innovation etc).
[1] I don't but tempted to try, like its data-types concept
[2] https://jqlang.github.io/jq/
[3] https://github.com/mithrandie/csvq
-
Tool to interact with CSV
csvq
-
Can SQL be used without an RDBMS?
There is a way of running SQL-like queries against CSV files.
-
Yq is a portable yq: command-line YAML, JSON, XML, CSV and properties processor
Lately I have had to do a lot of flat file analysis and tools along these lines have been a godsend. Will check this out.
My go to lately has been csvq (https://mithrandie.github.io/csvq/). Really nice to be able run complicated selects right over a CSV file with no setup at all.
-
Wie fusioniert man CSV tables?
csvq (https://mithrandie.github.io/csvq/)
-
Tool to explore big data sets
I usually do this with awk, my largest target files being half a TB in size for a project last year (and far too large to hold entirely in RAM). There are some other utilities like csvq and csvsql both of which let you write SQL-style queries against CSV files, but I'm not sure how they perform on large files. There's a nice list of CSV manipulation tools too if any of those jog your memory.
-
sqly - execute SQL against CSV / JSON with shell
Apparently, there were many who thought the same thing; Tools to execute SQL against CSV were trdsql, q, csvq, TextQL. They were highly functional, hoewver, had many options and no input completion. I found it just a little difficult to use.
- One-liner for running queries against CSV files with SQLite
-
Most efficient way to query .CSV files for Mac?
Please check out this tool https://github.com/mithrandie/csvq
-
Looking for: library to turn SQL (or abstracted) to code & execute against custom backend (slice of structs)
If you are looking to query nondb data with sql statements then you may want to check something like https://github.com/mithrandie/csvq (SQL for csv).
csvkit
-
I wrote this iCalendar (.ics) command-line utility to turn common calendar exports into more broadly compatible CSV files.
CSV utilities (still haven't pick a favorite one...): https://github.com/harelba/q https://github.com/BurntSushi/xsv https://github.com/wireservice/csvkit https://github.com/johnkerl/miller
- Icsp – Command-line iCalendar (.ics) to CSV parser
-
Tool to interact with CSV
I used to use csvkit tools, but at some point I had issues with some conversions of values (I don't remember the details).
-
This Week In Python
csvkit – A suite of utilities for converting to and working with CSV
-
How to log query in Postgres container Docker to CSV file
I recommend you add a header column to CSV file that we got so it's easy to implement and use a tool like csvkit to filter data.
- Do you know of any website that has a bunch of files for CSV parser edge case testing?
- If you want to run SQL queries on CSV files from the command line without installing/opening any DBMS software, use CSVKIT
What are some alternatives?
querycsv - QueryCSV enables you to load CSV files and manipulate them using SQL queries then after you finish you can export the new values to a CSV file
Kaitai Struct - Kaitai Struct: declarative language to generate binary data parsers in C++ / C# / Go / Java / JavaScript / Lua / Nim / Perl / PHP / Python / Ruby
q - q - Run SQL directly on delimited files and multi-file sqlite databases
pymorphy2 - Morphological analyzer / inflection engine for Russian and Ukrainian languages.
yq - yq is a portable command-line YAML, JSON, XML, CSV, TOML and properties processor
Python-Schema-Matching - A python tool using XGboost and sentence-transformers to perform schema matching task on tables.
yq - Command-line YAML, XML, TOML processor - jq wrapper for YAML/XML/TOML documents
miller - Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
binary-csv - A fast, streaming CSV binary parser written in javascript
duckdb - DuckDB is an in-process SQL OLAP Database Management System
xsv - A fast CSV command line toolkit written in Rust.