sqlite-utils-litecli
sqlite-utils-jq
sqlite-utils-litecli | sqlite-utils-jq | |
---|---|---|
1 | 2 | |
11 | 8 | |
- | - | |
5.0 | 3.7 | |
11 months ago | 10 months ago | |
Python | Python | |
Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sqlite-utils-litecli
sqlite-utils-jq
-
Welcome to Datasette Cloud
There are a few things you can do here.
SQLite is great at JSON - so I often dump JSON structures in a TEXT column and query them using https://www.sqlite.org/json1.html
I also have plugins for running jq() functions directly in SQL queries - https://datasette.io/plugins/datasette-jq and https://github.com/simonw/sqlite-utils-jq
I've been trying to drive the cost of turning semi-structured data into structured SQL queries down as much as possible with https://sqlite-utils.datasette.io - see this tutorial for more: https://datasette.io/tutorials/clean-data
This is also an area that I'm starting to explore with LLMs. I love the idea that you could take a bunch of messy data, tell Datasette Cloud "I want this imported into a table with this schema"... and it does that.
I have a prototype of this working now, I hope to turn it into an open source plugin (and Datasette Cloud feature) pretty soon. It's using this trick: https://til.simonwillison.net/gpt3/openai-python-functions-d...
-
SQLite Functions for Working with JSON
Since SQLite supports custom SQL functions, you can add JQ support to it pretty easily.
I just threw together a plugin for my sqlite-utils CLI tool that adds a jq() function here:
https://github.com/simonw/sqlite-utils-jq
Use it like this:
sqlite-utils memory "select jq(:doc, :expr) as result" \
What are some alternatives?
litecli - CLI for SQLite Databases with auto-completion and syntax highlighting
pyjq - A Python binding for ./jq
txtai - 💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
sqlitebson - BSON extension for sqlite
datasette - An open source multi-tool for exploring and publishing data
sqlite-utils - Python CLI utility and library for manipulating SQLite databases
grist-core - Grist is the evolution of spreadsheets.