Run SQL on CSV, Parquet, JSON, Arrow, Unix Pipes and Google Sheet

1. roapi

   1 26 3,274 7.9 Rust

   Create full-fledged APIs for slowly moving datasets without writing a single line of code.

   

2. CodeRabbit

   coderabbit.ai featured

   CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

   

3. py-spy

   2 27 13,369 7.6 Rust

   Sampling profiler for Python programs

   

   It is pretty cool. py-spy has also been doing this for a few years

   https://github.com/benfred/py-spy

4. blaze

   3 9 1,428 9.6 Rust

   Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core. (by kwai)

   

   Datafusion out performs spark by a large margin. It is on par with photon, see benchmark at https://github.com/blaze-init/blaze.

5. lnav

   4 85 8,473 9.8 C++

   Log file navigator

   

   Oh, okay... https://lnav.org is a log file viewer for the terminal that integrates with SQLite so you can use SQL to query your log files.

6. dsq

   5 20 3,774 4.3 Go

   Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more.

   

   I am currently evaluating dsq and its partner desktop app DataStation. AIUI, the developer of DataStation realised that it would be useful to extract the underlying pieces into a standalone CLI, so they both support the same range of sources.

   dsq CLI - https://github.com/multiprocessio/dsq

7. dasel

   6 46 7,369 5.8 Go

   Select, put and delete data from JSON, TOML, YAML, XML and CSV files with a single tool. Supports conversion between formats and can be used as a Go package.

   

8. octosql

   7 35 4,983 2.7 Go

   OctoSQL is a query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL.

   

9. Nutrient

   www.nutrient.io featured

   Nutrient – The #1 PDF SDK Library, trusted by 10K+ developers. Other PDF SDKs promise a lot - then break. Laggy scrolling, poor mobile UX, tons of bugs, and lack of support cost you endless frustrations. Nutrient’s SDK handles billion-page workloads - so you don’t have to debug PDFs. Used by ~1 billion end users in more than 150 different countries.

   

10. xsv

    8 67 10,552 0.0 Rust

    A fast CSV command line toolkit written in Rust.

    

11. zsv

    9 27 222 9.3 C

    zsv+lib: tabular data swiss-army knife CLI + world's fastest (simd) CSV parser

    

Suggest a related project