json2csv VS dflat

Convert to CSV https://github.com/zemirco/json2csv

I just went through a similar process trying to stream large amounts of database records into a csv file. A great help was json2csv. Check out their docs to understand streams.

I read it as "I already have or can easily get a folder of JSON files (each representing a table); I want to open them up in SQLite with nearly zero effort."

That should be hackable with something like json2csv[1], but I imagine the intent is a desire for something supported, rather than awfully hacked up.

1 - https://github.com/zemirco/json2csv

This is really, IMHO (as someone implements things on top of SQLite too https://dflat.io) pushes SQLite too far as the implementation of cross-db transactions have some big issues: https://www.sqlite.org/limits.html (the number of attached databases cannot exceed 10 or 125 (if you compile your own)) https://www.sqlite.org/wal.html (in WAL mode, there is no transactional guarantee for cross database transactions (atomic per database, but not cross database))

Dflat: SQLite FlatBuffers\ (4 comments)

Flatbuffers would be better as it doesn't need to deserialize at all (I think protobuf supports to partially deserialization nowadays?). I did something similar with https://dflat.io/ too!