sqlite-s3-query
ws4sqlite
| sqlite-s3-query | ws4sqlite | |
|---|---|---|
| 5 | 7 | |
| 240 | 390 | |
| - | - | |
| 7.5 | 7.3 | |
| about 2 months ago | 7 days ago | |
| Python | Go | |
| MIT License | ISC License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sqlite-s3-query
-
Using Lidar to map tree shadows
Awesome project!
What about hosting the data in an S3 bucket with "Requestor Pays"? You'd only have the storage cost.
Disables anonymous access (so would a Dropbox share) but reduces your cost massively.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/Reques...
You wouldn't necessarily need an SQL frontend as it's readonly anyway, and there are multiple ways of letting SQLite access databases in S3 buckets, e.g. https://github.com/michalc/sqlite-s3-query
-
Show HN: Query SQLite files stored in S3
Aha! This is done in https://github.com/uktrade/mbtiles-s3-server, but using an alternative library to query SQLite on S3, https://github.com/michalc/sqlite-s3-query
(Full disclosure: I wrote most of both of these)
-
Show HN: Mbtiles-S3-server – serve vector map tiles directly from mbtiles on S3
I was wondering how this ran queries against SQLite files in an S3 bucket. Here's the answer - it's using some very clever Python ctypes code to implement that HTTP Range header trick from last year:
https://github.com/michalc/sqlite-s3-query/blob/main/sqlite_...
Here's the inspiration for that: https://github.com/phiresky/sql.js-httpvfs
- Ws4sqlite: Query SQLite via HTTP
- Show HN: SQLite-S3-query – Python function to query a SQLite database on S3
ws4sqlite
-
ws4sqlite v0.12.1 released - connect to sqlite via HTTP/"REST"
If you are interested, feel free to browse the git repo, read the documentation (with a tutorial) or connect to the discord channel.
-
Ask HN: Have you used SQLite as a primary database?
I am using sqlite where a simple persistence layer is needed, both as the sole in the project or along with a full-fledged database. There are many such projects, once you realize that a database is just an abstraction; for example, for caching in a larger project, or to store results for a subsection of the project. But of course also for smaller, standalone projects.
Also, take a look at ws4sqlite (https://germ.gitbook.io/ws4sqlite/) for a middle ground between SQLite (embedded) and rqlite/dqlite: it's "normal" sqlite addressable via web services. May be useful in some scenarios.
-
Hacker News top posts: Mar 11, 2022
Ws4sqlite: Query SQLite via HTTP\ (30 comments)
- Ws4sqlite: Query SQLite via HTTP
-
A remote JSON interface for SQLite, in Go
ws4sqlite is a web service layer on one (or more) SQLite databases. It’s written in Go, over mattn's go-sqlite3, and allows to use HTTP POST requests to submit SQL statements to a database, in a transaction. It can “serve” multiple databases at once, supports authentication, “stored queries”, in-memory databases, maintenance (vacuum/backups), batching and several other security features and configurations.
What are some alternatives?
sqlite3vfshttp - Go sqlite3 http vfs: query sqlite databases over http with range headers
tuql - Automatically create a GraphQL server from a SQLite database or a SQL file
athena-sqlite - A SQLite driver for S3 and Amazon Athena 😳
dashera - DasherA is a Data General DASHER D200/D210 terminal emulator
Sqinn-Go - Golang SQLite without cgo
sql.js-httpvfs - Hosting read-only SQLite databases on static file hosters like Github Pages
barrier - Open-source KVM software
ngx_http_mbtiles_module - A nginx module to serve map tiles directly from mbtiles container files
go-sqlite3 - sqlite3 driver for go using database/sql