Cross-Database Queries in SQLite

This page summarizes the projects mentioned and recommended in the original post on

Our great sponsors
  • SonarLint - Clean code begins in your IDE with SonarLint
  • Mergify - Updating dependencies is time-consuming.
  • InfluxDB - Collect and Analyze Billions of Data Points in Real Time
  • upm

    ⠕ Universal Package Manager - Python, Node.js, Ruby, Emacs Lisp.

  • datasette

    An open source multi-tool for exploring and publishing data

    I'm using datasette[0] and sqlite-utils[1] on replit[2] for a project, which unfortunately I can't share for the time being. I've been very productive, and the low learning curve on this setup makes it easy for others to use and modify what I've done.

    I expect to have time to make a demo datasette project available on replit (and github) 'soon.'

    I'm so grateful for @simonw 's work on datasette and sqlite! These packages are beautifully designed and documented, and they work so well! Thank you very much @simonw!


  • SonarLint

    Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.

  • moonfire-nvr

    Moonfire NVR, a security camera network video recorder

    I use it in a network video recorder.

    Data in a flat file would be much less efficient, and a SQL server (eg PostgreSQL) would be more for the administrator to deal with. SQLite's a nice sweet spot.

    I've thought about using a key/value database (either a BTree one like SQLite uses under the hood or a LSM one like RocksDB). It'd be faster and less total code. But SQLite's too convenient to give up. The SQL interface is nice for debugging in particular. And it's already plenty fast enough, so my time's better spent adding some glaring missing features and better UI.

  • Magnetico

    Autonomous (self-hosted) BitTorrent DHT search engine suite.

    I'm using magnetico (, a selfhosted bittorrent DHT scraper. After a few months of running I now have a little bit under 1M magnets in a ~3G database. SQLite is useful not just because I can query it with the full power of a relational database, but because I'm using its FTS capability for searching.

    If I had to install a typical database or some search engine I would never have used it. It is more than enough for what I'm using it for.

  • WCDB

    WCDB is a cross-platform database framework developed by WeChat.

    SQLite is so ubiquitous you'd be hard pressed to find an app or service that doesn't use it.

    Look through the licenses for the software included as part of your phone's OS. You'll find SQLite in there.

    Search GitHub for sqlite, there are several projects with thousands of stars that use SQLite. Here's one:

  • benchpress

    Testing and benchmarking tool for logic-related programs. (by sneeuwballen)

    It's a really cool feature of sqlite. I use it in a prover benchmark tool [1] where each run produces a new sqlite file that I can rsync elsewhere. The tool can then list these files and connect to multiple files to do joins across them (to compare results from different runs). It's very convenient.


  • dolt

    Dolt – Git for Data

    I think this is an excellent architecture for powerful, respectful, hosted applications. I’ve been thinking about a few extensions of this idea:

    First, use advances in privacy technology to create a service-wide data warehouse that has enough information to help you make good decisions without exposing any specific user’s data. Done properly, users will benefit from your improved decision-making without giving up their personal data. Differential Privacy can do this.

    Second, give users the opportunity to download their own little database in native format (e.g. SQLite) This is the ultimate in data portability. I think Dolt [0] might be good for this, because its git-like approach gives you push/pull syncing as well as diffing. That would make it easy for users to keep a local copy of the data up to date.

    Third, you can start to support self-hosting and perhaps even open-source the primary user-facing application. The hosted service sells convenience and features enabled by the privacy-respecting data warehouse.

    The big questions, of course, are many:

    - Would users pay for this?

    - Does increased development cost and reduced velocity outweigh the privacy benefits?

    - Would the open-source component enable clones that undermine your business, or attract new users who may eventually upgrade to your paid service?

    I would like to find out the answers!


  • Mergify

    Updating dependencies is time-consuming.. Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts