Create full-fledged APIs for slowly moving datasets without writing a single line of code.
Neat! I have also built a similar project in Rust https://github.com/roapi/roapi/tree/main/columnq-cli :)
q - Run SQL directly on delimited files and multi-file sqlite databases (by harelba)
dsq references a benchmark done by q (https://github.com/harelba/q/blob/master/test/BENCHMARK.md) that indicates that octosql is significantly slower.
However, octosql's GH repo claims otherwise.
Does anyone have any real world experience that they can share on these tools?
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
go-duckdb provides a database/sql driver for the DuckDB database engine.
Yeah frankly the q benchmark isn't the best even though dsq compares favorably in it. It isn't well documented and exercises a very limited amount of functionality and isn't very rigorous from what I can see. That said, the caching q does is likely very solid (and not something dsq does).
The biggest risk I think with octosql (and cube2222 is here somewhere to disagree with me if I'm wrong) is that they have their own entire SQL engine whereas textql, q and dsq use SQLite. But q is also in Python whereas textql, octosql, and dsq are in Go.
In the next few weeks I'll be posting some benchmarks that I hope are a little fairer (or at least well-documented and reproducible). Though of course it would be appropriate to have independent benchmarks too since I now have a dog in the fight.
On a tangent, once the go-duckdb binding  matures I'd love to offer duckdb as an alternative engine flag within dsq (and DataStation). Would be neat to see.
Execute SQL against structured text like CSV or TSV
Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more.
Binaries are now available! https://github.com/multiprocessio/dsq#macos-linux
SPyQL – SQL with Python in the Middle
3 projects | news.ycombinator.com | 24 Jan 2022
A fast SQLite PWA notebook for CSV files
6 projects | news.ycombinator.com | 30 Dec 2021
End of the snahp blog | Invitation for data hoarders
1 project | reddit.com/r/DataHoarder | 24 Sep 2021
Show HN: Columnq brings OLAP to Unix pipes
2 projects | news.ycombinator.com | 13 Sep 2021
Show HN: Query small data with columnq CLI
1 project | news.ycombinator.com | 6 Sep 2021