What If OpenDocument Used SQLite?

• sqlitefs

  4 46 10.0 Rust

  sqlite as a filesystem

• wuffs

  80 3,743 9.4 C

  Wrangling Untrusted File Formats Safely

  

> parsing encoded files tends to introduce vulnerabilities

If we are talking about binary formats, now there are systematic solutions like https://github.com/google/wuffs that protect against vulnerabilities. But SQLite is not just a format - it's an evolving ecosystem with constantly added features. And the most prominent issue was not even in core, it was in FTS3. What will SQLite add next? More json-related functions? Maybe BSON? It is useful, but does not help in this situation.

Regarding traces, there are many forensics tools and even books about forensic analysis of SQLite databases. In well-designed format such tools should not exist in the first place. This is hard requirement: if it requires rewriting the whole file - then so be it.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• amazon-rds-user-guide

  1 151 10.0

  Discontinued The open source version of the Amazon RDS docs. You can submit feedback & requests for changes by submitting issues in this repo or by making proposed changes & submitting a pull request.

  

It only allows that if you’ve set it to do so. The default SQL_MODE variable includes ONLY_FULL_GROUP_BY.

However, in their brilliance, AWS RDS defaults to only NO_ENGINE_SUBSTITUTION for SQL_MODE, thus merrily allowing partial aggregates with non-deterministic results. Wheee!

https://github.com/awsdocs/amazon-rds-user-guide/issues/160

• stream-read-ods

  2 1 4.4 Python

  Python function to extract data from an ODS spreadsheet on the fly - without having to store the entire file in memory or disk

  

Shameless plug of a couple of Python libraries I’ve been involved with that work around memory issues of ODS files (for very specific use cases):

https://github.com/uktrade/stream-read-ods

• stream-write-ods

  2 3 4.7 Python

  Python function to construct an ODS spreadsheet on the fly - without having to store the entire file in memory or disk

  

• sqljs

  1 0 2.1 TypeScript

  Experiments with sqlite databases in javascript

It's interesting that this is a classroom assignment, like the sibling comment, I'd curious which university / class this was. I did the read part (+ query planning) on my own as an exercise, but I haven't gotten around to implementing writing yet.

You do need to parse DDL to get the column names, they're stored as a "CREATE TABLE" string. But you don't have to if you want to dump the file without names.

https://github.com/dunhamsteve/sqljs

• sqlitefs

  2 12 4.7 Go

  sqlite as a filesystem for golang apps (by jilio)

In any case, homebrew can't install prerequisite osxfuse onto Ventura.

There is also this, which seems to work: https://github.com/jilio/sqlitefs

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• absurd-sql

  24 4,057 2.5 JavaScript

  sqlite3 in ur indexeddb (hopefully a better backend soon)

Suggest a related project