A SQLite extension for reading large files line-by-line

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • sqlite-lines

    A SQLite extension for reading large files line-by-line (NDJSON, logs, txt, etc.)

  • xlite

    Query Excel spredsheets (.xlsx, .xls, .ods) using SQLite

  • Hey, author here, happy to answer any questions! Also checkout this notebook for a deeper dive into sqlite-lines, along with a slick WASM demonstration and more thoughts on the codebase itself https://observablehq.com/@asg017/introducing-sqlite-lines

    I really dig SQLite, and I believe SQLite extensions will push it to another level. I rarely reach for Pandas or other "traditional" tools and query languages, and instead opt for plain ol' SQLite and other extensions. As a shameless plug, I recently started a blog series on SQLite and related tools and extensions if you want to learn more! Next week I'll be publishing more SQLite extensions for parsing HTML + making HTTP requests https://observablehq.com/@asg017/a-new-sqlite-blog-series

    A few other SQLite extensions:

    - xlite, for reading Excel files, in Rust https://github.com/x2bool/xlite

    - sqlean, several small SQLite extensions in C https://github.com/nalgeon/sqlean

    - mergestat, several SQLite extensions for developers (mainly Github's API) in Go https://github.com/mergestat/mergestat

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • sqlite-plus

    The ultimate set of SQLite extensions

  • Hey, author here, happy to answer any questions! Also checkout this notebook for a deeper dive into sqlite-lines, along with a slick WASM demonstration and more thoughts on the codebase itself https://observablehq.com/@asg017/introducing-sqlite-lines

    I really dig SQLite, and I believe SQLite extensions will push it to another level. I rarely reach for Pandas or other "traditional" tools and query languages, and instead opt for plain ol' SQLite and other extensions. As a shameless plug, I recently started a blog series on SQLite and related tools and extensions if you want to learn more! Next week I'll be publishing more SQLite extensions for parsing HTML + making HTTP requests https://observablehq.com/@asg017/a-new-sqlite-blog-series

    A few other SQLite extensions:

    - xlite, for reading Excel files, in Rust https://github.com/x2bool/xlite

    - sqlean, several small SQLite extensions in C https://github.com/nalgeon/sqlean

    - mergestat, several SQLite extensions for developers (mainly Github's API) in Go https://github.com/mergestat/mergestat

  • mergestat-lite

    Query git repositories with SQL. Generate reports, perform status checks, analyze codebases. 🔍 📊

  • Hey, author here, happy to answer any questions! Also checkout this notebook for a deeper dive into sqlite-lines, along with a slick WASM demonstration and more thoughts on the codebase itself https://observablehq.com/@asg017/introducing-sqlite-lines

    I really dig SQLite, and I believe SQLite extensions will push it to another level. I rarely reach for Pandas or other "traditional" tools and query languages, and instead opt for plain ol' SQLite and other extensions. As a shameless plug, I recently started a blog series on SQLite and related tools and extensions if you want to learn more! Next week I'll be publishing more SQLite extensions for parsing HTML + making HTTP requests https://observablehq.com/@asg017/a-new-sqlite-blog-series

    A few other SQLite extensions:

    - xlite, for reading Excel files, in Rust https://github.com/x2bool/xlite

    - sqlean, several small SQLite extensions in C https://github.com/nalgeon/sqlean

    - mergestat, several SQLite extensions for developers (mainly Github's API) in Go https://github.com/mergestat/mergestat

  • octosql

    OctoSQL is a query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL.

  • spyql

    Query data on the command line with SQL-like SELECTs powered by Python expressions

  • spl.js

    SpatiaLite for browser & node

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • datasette-lite

    Datasette running in your browser using WebAssembly and Pyodide

  • Oh wow! I wonder how hard it would be to load that module into https://github.com/simonw/datasette-lite

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • The fastest tool for querying JSON files is *not* written in Python (revised)

    2 projects | news.ycombinator.com | 21 Apr 2022
  • A fast SQLite PWA notebook for CSV files

    6 projects | news.ycombinator.com | 30 Dec 2021
  • Show HN: Work with CSV files using SQL. For data scientists and engineers

    10 projects | news.ycombinator.com | 18 Jul 2021
  • CLI tool to import/export csv/xlsx files and run SQL queries

    1 project | /r/SideProject | 13 Jun 2021
  • Show HN: TextQuery – Query and Visualize Your CSV Data in Minutes

    3 projects | news.ycombinator.com | 2 Apr 2024