Run SQL on CSV, Parquet, JSON, Arrow, Unix Pipes and Google Sheet

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Our great sponsors
  • Scout APM - Truly a developer’s best friend
  • SonarQube - Static code analysis for 29 languages.
  • Zigi - Workflow assistant built for devs & their teams
  • InfluxDB - Build time-series-based applications quickly and at scale.
  • roapi

    Create full-fledged APIs for slowly moving datasets without writing a single line of code.

  • py-spy

    Sampling profiler for Python programs

    It is pretty cool. py-spy has also been doing this for a few years

    https://github.com/benfred/py-spy

  • Scout APM

    Truly a developer’s best friend. Scout APM is great for developers who want to find and fix performance issues in their applications. With Scout, we'll take care of the bugs so you can focus on building great things 🚀.

  • blaze

    Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core. (by blaze-init)

    Datafusion out performs spark by a large margin. It is on par with photon, see benchmark at https://github.com/blaze-init/blaze.

  • dsq

    Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more.

    I am currently evaluating dsq and its partner desktop app DataStation. AIUI, the developer of DataStation realised that it would be useful to extract the underlying pieces into a standalone CLI, so they both support the same range of sources.

    dsq CLI - https://github.com/multiprocessio/dsq

  • dasel

    Select, put and delete data from JSON, TOML, YAML, XML and CSV files with a single tool. Supports conversion between formats and can be used as a Go package.

  • octosql

    OctoSQL is a query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL.

  • SonarQube

    Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.

  • xsv

    A fast CSV command line toolkit written in Rust.

  • zsv

    zsv+lib: world's fastest (simd) CSV parser, with an extensible CLI for SQL querying, format conversion and more

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts