Run SQL on CSV, Parquet, JSON, Arrow, Unix Pipes and Google Sheet

• roapi

  3 3,069 6.9 Rust

  Create full-fledged APIs for slowly moving datasets without writing a single line of code.

  

• py-spy

  6 11,782 6.7 Rust

  Sampling profiler for Python programs

  It is pretty cool. py-spy has also been doing this for a few years

  https://github.com/benfred/py-spy

• InfluxDB

  www.influxdata.com

  sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• blaze

  1 872 9.3 Rust

  Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core. (by kwai)

  

  Datafusion out performs spark by a large margin. It is on par with photon, see benchmark at https://github.com/blaze-init/blaze.

• lnav

  24 6,607 9.5 C++

  Log file navigator

  Oh, okay... https://lnav.org is a log file viewer for the terminal that integrates with SQLite so you can use SQL to query your log files.

• dsq

  1 3,603 4.3 Go

  Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more.

  

  I am currently evaluating dsq and its partner desktop app DataStation. AIUI, the developer of DataStation realised that it would be useful to extract the underlying pieces into a standalone CLI, so they both support the same range of sources.

  dsq CLI - https://github.com/multiprocessio/dsq

• dasel

  1 4,846 8.2 Go

  Select, put and delete data from JSON, TOML, YAML, XML and CSV files with a single tool. Supports conversion between formats and can be used as a Go package.

• octosql

  1 4,687 4.3 Go

  OctoSQL is a query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL.

• WorkOS

  workos.com

  sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• xsv

  4 10,046 0.0 Rust

  A fast CSV command line toolkit written in Rust.

• zsv

  0 169 7.4 C

  zsv+lib: world's fastest (simd) CSV parser, bare metal or wasm, with an extensible CLI for SQL querying, format conversion and more

Suggest a related project