elevation
sqlite-s3-query
| elevation | sqlite-s3-query | |
|---|---|---|
| 1 | 5 | |
| 8 | 241 | |
| - | - | |
| 9.5 | 7.5 | |
| 11 days ago | 2 months ago | |
| JavaScript | Python | |
| GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
elevation
-
Using Lidar to map tree shadows
Those comments were more at pastmaps.
For elevation data, we store our DEM/DSM in S3 as LERC [1] COGS, LERC has a WASM bundle which I think can be used in the browser. We found LERC COGs to be one of the most space efficient ways of storing highresolution DEM/DSM data [2], If you wanted to you could fetch LERC tiles directly out of a remote COG and use that directly for the terrain heights.
I am more focused on storage/archiving/publishing of our LiDAR capture program [3] than web based visualizations of it though, so I am unsure if a LERC COG would even be better for you than a PNG TerrainRGB.
[1] https://www.npmjs.com/package/lerc
[2] https://github.com/linz/elevation/tree/master/docs/tiff-comp...
[3] https://linz.maps.arcgis.com/apps/MapSeries/index.html?appid...
sqlite-s3-query
-
Using Lidar to map tree shadows
Awesome project!
What about hosting the data in an S3 bucket with "Requestor Pays"? You'd only have the storage cost.
Disables anonymous access (so would a Dropbox share) but reduces your cost massively.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/Reques...
You wouldn't necessarily need an SQL frontend as it's readonly anyway, and there are multiple ways of letting SQLite access databases in S3 buckets, e.g. https://github.com/michalc/sqlite-s3-query
-
Show HN: Query SQLite files stored in S3
Aha! This is done in https://github.com/uktrade/mbtiles-s3-server, but using an alternative library to query SQLite on S3, https://github.com/michalc/sqlite-s3-query
(Full disclosure: I wrote most of both of these)
-
Show HN: Mbtiles-S3-server – serve vector map tiles directly from mbtiles on S3
I was wondering how this ran queries against SQLite files in an S3 bucket. Here's the answer - it's using some very clever Python ctypes code to implement that HTTP Range header trick from last year:
https://github.com/michalc/sqlite-s3-query/blob/main/sqlite_...
Here's the inspiration for that: https://github.com/phiresky/sql.js-httpvfs
- Ws4sqlite: Query SQLite via HTTP
- Show HN: SQLite-S3-query – Python function to query a SQLite database on S3
What are some alternatives?
maplibre-gl-js - MapLibre GL JS - Interactive vector tile maps in WebGL2
sqlite3vfshttp - Go sqlite3 http vfs: query sqlite databases over http with range headers
athena-sqlite - A SQLite driver for S3 and Amazon Athena 😳
tuql - Automatically create a GraphQL server from a SQLite database or a SQL file
sql.js-httpvfs - Hosting read-only SQLite databases on static file hosters like Github Pages
ws4sqlite - Query sqlite via json+http
ngx_http_mbtiles_module - A nginx module to serve map tiles directly from mbtiles container files
go-sqlite3 - sqlite3 driver for go using database/sql
mbtiles-s3-server - Python server to on-the-fly extract and serve vector tiles from an mbtiles file on S3
rqlite - The lightweight, distributed relational database built on SQLite.
verneuil - Verneuil is a VFS extension for SQLite that asynchronously replicates databases to S3-compatible blob stores.
com-tiles - Streamable and read optimized file archive for hosting map tiles at global scale on a cloud object storage