Show HN: Easily Convert WARC (Web Archive) into Parquet, Then Query with DuckDB

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com
Sqlite Python Datasets JSON Docker

InfluxDB
Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • warc-parquet

    🗄️ A simple CLI for converting WARC to Parquet.

  • sqlite-parquet-vtable

    A SQLite vtable extension to read Parquet files

    • Well there's a virtual table extension to read parquet files in SQLite. I've not tried it myself. https://github.com/cldellow/sqlite-parquet-vtable

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • datasette

    An open source multi-tool for exploring and publishing data

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts