SQLite Functions for Working with JSON

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • oxide

    Teach your PostgreSQL database how to speak MongoDB Wire Protocol

  • I started working in a MongoDB wire protocol adapter layer to a PostgreSQL backend and it relies heavily on the use of JSON functions I was really wanting to also allow for SQLite as a backend but not sure if we can do everything that can be done in Postgres. If anyone want to take a look and colaborate on that, here’s a link to the project:

    https://oxidedb.com

    And a quick ui for a quick try:

    https://demo.oxidedb.com

  • txtai

    💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

  • The built-in JSON functionality is very powerful. txtai (https://github.com/neuml/txtai) takes full advantage of it and stores all relational data as JSON in SQLite.

    The ability to build indexes on these JSON function is important. Found this article to be a good reference: https://www.delphitools.info/2021/06/17/sqlite-as-a-no-sql-d...

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • sqlite-utils-jq

    Plugin adding a jq() SQL function to sqlite-utils

  • Since SQLite supports custom SQL functions, you can add JQ support to it pretty easily.

    I just threw together a plugin for my sqlite-utils CLI tool that adds a jq() function here:

    https://github.com/simonw/sqlite-utils-jq

    Use it like this:

        sqlite-utils memory "select jq(:doc, :expr) as result" \

  • sqlite-utils-litecli

    Interactive shell for sqlite-utils using litecli

  • litecli

    CLI for SQLite Databases with auto-completion and syntax highlighting

  • GitHub: https://github.com/dbcli/litecli

  • sqlite-utils

    Python CLI utility and library for manipulating SQLite databases

  • I've baked a ton of different SQLite tricks - including things like full-text indexing support and advanced alter table methods - into my sqlite-utils CLI tool and Python library: https://sqlite-utils.datasette.io

    My Datasette project provides tools for exploring, analyzing and publishing SQLite databases, plus ways to expose them via a JSON API: https://datasette.io

    I've also written a ton of stuff about SQLite on my two blogs:

    - https://simonwillison.net/tags/sqlite/

    - https://til.simonwillison.net/sqlite

  • datasette

    An open source multi-tool for exploring and publishing data

  • I've baked a ton of different SQLite tricks - including things like full-text indexing support and advanced alter table methods - into my sqlite-utils CLI tool and Python library: https://sqlite-utils.datasette.io

    My Datasette project provides tools for exploring, analyzing and publishing SQLite databases, plus ways to expose them via a JSON API: https://datasette.io

    I've also written a ton of stuff about SQLite on my two blogs:

    - https://simonwillison.net/tags/sqlite/

    - https://til.simonwillison.net/sqlite

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • pyjq

    A Python binding for ./jq

  • It uses the libjq C library directly, integrating with it using Cython https://github.com/doloopwhile/pyjq/blob/master/_pyjq.pyx

  • sqlitebson

    BSON extension for sqlite

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts