Show HN: Query SQLite files stored in S3

• s3sqlite

  5 457 0.0 Python

  Query SQLite files in S3 using s3fs

  

• verneuil

  5 392 6.7 C

  Verneuil is a VFS extension for SQLite that asynchronously replicates databases to S3-compatible blob stores.

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• litestream

  165 9,964 7.5 Go

  Streaming replication for SQLite.

• mvsqlite

  26 1,318 0.0 Rust

  Distributed, MVCC SQLite that runs on FoundationDB.

That DynamoDB VFS looks cool! I agree that the VFS api makes one think about plenty of crazy ideas. Someone is working on a VFS based on Foundation DB[0] that looks very promising. It was recently discussed here[1]

[0]: https://github.com/losfair/mvsqlite

[1]: https://news.ycombinator.com/item?id=32269287

• s3fs

  7 813 8.0 Python

  S3 Filesystem

  

• filesystem_spec

  1 895 9.2 Python

  A specification that python filesystems should adhere to.

  

• operations

  12 98 5.0

  OSMF Operations Working Group issue tracking

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• papers-we-love

  69 83,329 3.2 Shell

  Papers from the computer science community to read and discuss.

  

Ever since I read the "Out of the Tar Pit" paper[1], I've been designing my data structures in a more relational form.

[1]: https://github.com/papers-we-love/papers-we-love/blob/master...

• mbtiles-s3-server

  6 135 0.0 Python

  Python server to on-the-fly extract and serve vector tiles from an mbtiles file on S3

  

Aha! This is done in https://github.com/uktrade/mbtiles-s3-server, but using an alternative library to query SQLite on S3, https://github.com/michalc/sqlite-s3-query

(Full disclosure: I wrote most of both of these)

• sqlite-s3-query

  5 239 7.5 Python

  Python functions to query SQLite files stored on S3

Aha! This is done in https://github.com/uktrade/mbtiles-s3-server, but using an alternative library to query SQLite on S3, https://github.com/michalc/sqlite-s3-query

(Full disclosure: I wrote most of both of these)

Suggest a related project