The fastest tool for querying large JSON files is written in Python! (benchmark)

This page summarizes the projects mentioned and recommended in the original post on /r/Python

Our great sponsors
  • SurveyJS - Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • spyql

    Query data on the command line with SQL-like SELECTs powered by Python expressions

  • spyql is a tool (and python lib) for querying and transforming data. It is fully written in Python.

  • jfq

    JSONata on the command line

  • SurveyJS

    Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

    SurveyJS logo
  • ipython-sql

    %%sql magic for IPython, hopefully evolving into full SQL client

  • It makes sense considering A because lots of stuff that runs on top of SQLAlchemy would be able to use the spyql engine to query files using SQL. One example would be the IPython extension that allows typing SQL queries on Jupyter notebooks ipython-sql.

  • pxi

    🧚 pxi (pixie) is a small, fast, and magical command-line data processor similar to jq, mlr, and awk.

  • Very interesting piece of software :). I have put a lot of work in pxi, a very similar tool written in pure JavaScript. I am not here to start a flame war between Python and JavaScript btw., I am actually thrilled to find another person that has written a very similar project :).

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts