Sqlite-utils Alternatives
Similar projects and alternatives to sqlite-utils
-
q
q - Run SQL directly on delimited files and multi-file sqlite databases (by harelba)
-
sqlmodel
SQL databases in Python, designed for simplicity, compatibility, and robustness.
-
Scout APM
Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.
-
ImportExcel
PowerShell module to import/export Excel spreadsheets, without Excel
-
-
-
-
sqlitebrowser
Official home of the DB Browser for SQLite (DB4S) project. Previously known as "SQLite Database Browser" and "Database Browser for SQLite". Website at:
-
SonarLint
Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.
-
octosql
OctoSQL is a query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL.
-
-
-
-
-
-
-
PostgreSQL
Mirror of the official PostgreSQL GIT repository. Note that this is just a *mirror* - we don't work with pull requests on github. To contribute, please see https://wiki.postgresql.org/wiki/Submitting_a_Patch
-
-
visidata
A terminal spreadsheet multitool for discovering and arranging data
-
ultrajson
Ultra fast JSON decoder and encoder written in C with Python bindings
-
orjson
Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy
-
dasel
Select, put and delete data from JSON, TOML, YAML, XML and CSV files with a single tool. Supports conversion between formats and can be used as a Go package.
sqlite-utils reviews and mentions
-
Does anyone here use sqlite just to do quick queries, because it is easier than loading to another rdb?
https://sqlite-utils.datasette.io is the Python CLI tool and library I wrote to speed up this kind of work. Here's a recent tutorial I wrote about it: https://datasette.io/tutorials/clean-data
-
Awesome SQLite
sqlite-utils - CLI tool and Python utility functions for manipulating SQLite databases
- Need a database that can hold 16 million records and export any 2000 non-sequential records to Excel within 10 seconds.
-
The Design of SQLite4
You don't need to create a new table to add foreign keys - you can do it by setting PRAGMA writable_schema = 1, then updating the table definition directly in the sqlite_master table to include the foreign key constraints.
This sounds terrifyingly dangerous, so you should absolutely take a backup first - but I've found it to work just fine in practice.
Here's where I implement that in my sqlite-utils Python library and CLI tool:
https://github.com/simonw/sqlite-utils/blob/2d84577202e22767...
-
What’s the best cheap program to start??
If you are at all familiar with the command line I suggest using SQLite with my sqlite-utils tool - it works really well for this kind of project: https://sqlite-utils.datasette.io
-
projects in SQL
Export data from those as CSV, load them into a SQL database (I use SQLite and my combo of tools https://datasette.io/ and https://sqlite-utils.datasette.io/ for this) and see what interesting things you can find in them.
-
Toolchain recommendations for a production-quality monorepo?
I'm really happy using GitHub Actions for much of the other stuff you mentioned. I use mypy and flake8 - my most robust setup for that is this repo here: https://github.com/simonw/sqlite-utils
-
The fastest tool for querying large JSON files is written in Python (benchmark)
"Datasette" (from Django co-creator) can take tabular data (SQLite, CSV, JSON, etc) and generate a REST/GraphQL API with visualization tools from it:
https://github.com/simonw/datasette
From the same author, "sqlite-utils" can take tabular data and create SQLite table definitions and rows from them:
https://github.com/simonw/sqlite-utils
"Pipe JSON (or CSV or TSV) directly into a new SQLite database file, automatically creating a table with the appropriate schema"
> * What sort of JSON "meta-formats" are the most important/common for you? E.g. in a file you could have object-per-line, object-of-arrays, array-of-objects, or in an SQL context you could have object-per-row or object-of-arrays-as-table, etc). I'd love to hear about others that are important to you. - Ask HN: Local Tools for Viewing JSON
- New JSON query operators in SQLite 3.38.0
- A fast SQLite PWA notebook for CSV files
-
SQLModel: SQL DBs based on Python type hints. The biggest thing I've built since FastAPI and Typer. 😅
From JSON? I think you're looking for sqlite-utils (https://sqlite-utils.datasette.io). It is an amazing package for ingestion and transformation of sqlite databases. It does support JSON input and some level of nesting entities but i never use that specific feature myself. This is from Simon Willison, same guy behind Datasette (another amazing sqlite tool). Also co-creator of Django that doesn't need any introduction :D
- Show HN: Work with CSV files using SQL. For data scientists and engineers
-
The Untold Story of SQLite
Yes, I do this a lot. I've been building a tool to help with this: https://sqlite-utils.datasette.io/
-
Joining CSV and JSON data with an in-memory SQLite database
sqlite-utils isn't (yet) a dependency of Datasette.
The goal with sqlite-utils isn't to build an ORM - that .rows_where() method is definitely the most ORM-like piece of it, and it's purely there as a SQL-builder - it was a natural extension of the .rows property, which grew extra features (like order_by) over time as they were requested by users, eg https://github.com/simonw/sqlite-utils/issues/76
The vast majority of the library is aimed at making getting data IN to SQLite as easy as possible. Datasette is mainly about executing SELECT queries, and I found myself writing a lot of code to populate those database files - which grew into a combination library and CLI tool.
So yeah - I don't use the rows_where() feature much in my own code - I tend to use db.query() directly - but I've evolved the method over time based on user feedback. I don't have particularly strong opinions about it one way or the other.
Stats
simonw/sqlite-utils is an open source project licensed under Apache License 2.0 which is an OSI approved license.
Popular Comparisons
Are you hiring? Post a new remote job listing for free.