Dsq: Commandline tool for running SQL queries against JSON, CSV, Parquet, etc.

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Our great sponsors
  • SonarQube - Static code analysis for 29 languages.
  • Scout APM - Less time debugging, more time building
  • SaaSHub - Software Alternatives and Reviews
  • roapi

    Create full-fledged APIs for slowly moving datasets without writing a single line of code.

    Neat! I have also built a similar project in Rust https://github.com/roapi/roapi/tree/main/columnq-cli :)

  • q

    q - Run SQL directly on delimited files and multi-file sqlite databases (by harelba)

    dsq references a benchmark done by q (https://github.com/harelba/q/blob/master/test/BENCHMARK.md) that indicates that octosql is significantly slower.

    However, octosql's GH repo claims otherwise.

    Does anyone have any real world experience that they can share on these tools?

  • SonarQube

    Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.

  • go-duckdb

    go-duckdb provides a database/sql driver for the DuckDB database engine.

    Yeah frankly the q benchmark isn't the best even though dsq compares favorably in it. It isn't well documented and exercises a very limited amount of functionality and isn't very rigorous from what I can see. That said, the caching q does is likely very solid (and not something dsq does).

    The biggest risk I think with octosql (and cube2222 is here somewhere to disagree with me if I'm wrong) is that they have their own entire SQL engine whereas textql, q and dsq use SQLite. But q is also in Python whereas textql, octosql, and dsq are in Go.

    In the next few weeks I'll be posting some benchmarks that I hope are a little fairer (or at least well-documented and reproducible). Though of course it would be appropriate to have independent benchmarks too since I now have a dog in the fight.

    On a tangent, once the go-duckdb binding [0] matures I'd love to offer duckdb as an alternative engine flag within dsq (and DataStation). Would be neat to see.

    [0] https://github.com/marcboeker/go-duckdb

  • textql

    Execute SQL against structured text like CSV or TSV

  • dsq

    Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts