csvkit
q
| csvkit | q | |
|---|---|---|
| 9 | 46 | |
| 5,821 | 10,126 | |
| 0.5% | - | |
| 8.6 | 2.1 | |
| 3 days ago | 13 days ago | |
| Python | Python | |
| MIT License | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
csvkit
-
I wrote this iCalendar (.ics) command-line utility to turn common calendar exports into more broadly compatible CSV files.
CSV utilities (still haven't pick a favorite one...): https://github.com/harelba/q https://github.com/BurntSushi/xsv https://github.com/wireservice/csvkit https://github.com/johnkerl/miller
- Icsp – Command-line iCalendar (.ics) to CSV parser
-
Tool to interact with CSV
I used to use csvkit tools, but at some point I had issues with some conversions of values (I don't remember the details).
-
This Week In Python
csvkit – A suite of utilities for converting to and working with CSV
-
How to log query in Postgres container Docker to CSV file
I recommend you add a header column to CSV file that we got so it's easy to implement and use a tool like csvkit to filter data.
- Do you know of any website that has a bunch of files for CSV parser edge case testing?
- If you want to run SQL queries on CSV files from the command line without installing/opening any DBMS software, use CSVKIT
q
-
I wrote this iCalendar (.ics) command-line utility to turn common calendar exports into more broadly compatible CSV files.
CSV utilities (still haven't pick a favorite one...): https://github.com/harelba/q https://github.com/BurntSushi/xsv https://github.com/wireservice/csvkit https://github.com/johnkerl/miller
- Segítség kérés Excel automatizáláshoz
-
Show HN: ClickHouse-local – a small tool for serverless data analytics
I think they're talking about https://github.com/harelba/q, which is not very fast.
-
sqly - execute SQL against CSV / JSON with shell
Apparently, there were many who thought the same thing; Tools to execute SQL against CSV were trdsql, q, csvq, TextQL. They were highly functional, hoewver, had many options and no input completion. I found it just a little difficult to use.
-
Q – Run SQL Directly on CSV or TSV Files
Hi, author of q here.
Regarding the error you got, q currently does not autodetect headers, so you'd need to add -H as a flag in order to use the "country" column name. You're absolutely correct on failing-fast here - It's a bug which i'll fix.
In general regarding speed - q supports automatic caching of the CSV files (through the "-C readwrite" flag). Once it's activated, it will write the data into another file (with a .qsql extension), and will use it automatically in further queries in order to speed things considerably.
Effectively, the .qsql files are regular sqlite3 files (with some metadata), and q can be used to query them directly (or any regular sqlite3 file), including the ability to seamlessly join between multiple sqlite3 files.
http://harelba.github.io/q/#auto-caching-examples
- PostgreSQL alternative for Large amounts of data
-
q VS trdsql - a user suggested alternative
2 projects | 25 Jun 2022
- One-liner for running queries against CSV files with SQLite
What are some alternatives?
Kaitai Struct - Kaitai Struct: declarative language to generate binary data parsers in C++ / C# / Go / Java / JavaScript / Lua / Nim / Perl / PHP / Python / Ruby
textql - Execute SQL against structured text like CSV or TSV
pymorphy2 - Morphological analyzer / inflection engine for Russian and Ukrainian languages.
csvq - SQL-like query language for csv
Python-Schema-Matching - A python tool using XGboost and sentence-transformers to perform schema matching task on tables.
octosql - OctoSQL is a query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL.
miller - Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
InquirerPy - :snake: Python port of Inquirer.js (A collection of common interactive command-line user interfaces)
binary-csv - A fast, streaming CSV binary parser written in javascript
xsv - A fast CSV command line toolkit written in Rust.
ledger - Double-entry accounting system with a command-line reporting interface