PlanetilerTorrent
planetiler
PlanetilerTorrent | planetiler | |
---|---|---|
1 | 30 | |
2 | 1,185 | |
- | 3.0% | |
7.2 | 9.3 | |
5 months ago | 5 days ago | |
Shell | Java | |
- | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
PlanetilerTorrent
-
Protomaps – A free and open source map of the world
I've been testing a setup that automatically generates OpenStreetMap/OpenMapTiles formatted pmtiles and mbtiles, then makes them available by torrent. The torrents get placed in a rss feed at https://planetgen.wifidb.net/
Basically what I did was set up 'qbittorent' client to watch the openstreetmap rss feed. when it downloads a new pbf file, it runs this script I made at https://github.com/acalcutt/PlanetilerTorrent , which was based of the osm torrent creation process.
The script creates pmtiles and mbtiles, then makes torrent and starts seeding them in qbittorent.
In qbittorent I have options like how long I want to seed for (30 days), what do do when done seeding (Delete the files) and also speed controls so I can limit bandwidth during my working hours.
I have this running on a old laptop with 2TB nvme/64GB memory. It seeems to work pretty well so far. It would be nice if my internet speeds were a little better for initial seeding, but at least the torrents share the load with other people who are downloading/
planetiler
-
Protomaps – A free and open source map of the world
Worth mentioning this project (https://github.com/onthegomap/planetiler) that lets you create osm mbtiles and pmtiles pretty easy!
-
Radar Maps: $0.50 per 1K map loads
For a self-hosted vector tile stack you can have a look into https://github.com/onthegomap/planetiler I found it very easy to get started and when you know the other stacks it is also very fast to create these vector tiles even for planet-scale.
(note, that I'm not affiliated with them, but they use some source code from us for the efficient import and also contributed to GraphHopper, but this did not influence my experience ;) )
> I wonder why so many seem to be moving away from raster tiles to vector data.
The flexibility of styling. And you can easily serve customers that need different default languages. This makes maps also more accessible for countries without Latin alphabet.
-
I honestly don't like using most Openstreetmap websites: slow, clunky. Is there a better way to do this faster on my own desktop?
I used https://github.com/onthegomap/planetiler and https://download.geofabrik.de, maybe it helps.
- Mapping LA's Soft-Story Building Earthquake Retrofits [OC]
- Mapping LA's Soft-Story Building Earthquake Retrofit Program [OC]
-
SQLite performance tuning: concurrent reads, multiple GBs and 100k SELECTs/s
I spent a while optimizing sqlite inserts for planetiler, this is what I came up with:
https://github.com/onthegomap/planetiler/blob/db0ab02263baaa...
It batches inserts into bulk statements and is able to do writes in the 500k+ per second range, and reads are 300-400k/s using those settings.
-
How The Post is replacing Mapbox with open source solutions
Checkout https://github.com/onthegomap/planetiler.
Super easy way to generate a MBTiles, which you can then serve directly, or further convert to PMTiles, which can be used to host vector tiles for client-side rendering using MapLibre (or other renderers).
Raster tiles are a lot harder because you have to generate them on the server, and that's a lot more resource intensive.
-
Self-Hosted Vector Tiles
I built planetiler (https://github.com/onthegomap/planetiler) for this purpose. The output up to z14 is ~80gb and depending on how big of a machine you have it takes from 30 minutes up to a few hours - no DB required, just java or docker. If you are only going to z11-12, it should be quite a bit faster/smaller.
Brandon from Protomaps is also helping add pmtiles output natively to planetiler, so you won't need a conversion step afterwards!
-
Does anyone know where to find the global raster set of buildings??
It's not raster directly, but you could use planetiler ( https://github.com/onthegomap/planetiler ) to build a full planet vector map . Then you could use something like TileServer-GL to server the vector map with a style. TileServer-gl ( https://github.com/maptiler/tileserver-gl) would provide a raster source that displays in the style you set on your vector map.
-
Ask HN: Who wants to be hired? (January 2023)
I recently left Twitter after 9 years, most recently serving as tech lead for the knowledge graph group (was 45 people). I helped apply the KG to drive a large portion of Twitter’s revenue and new product launches. In my spare time I do data visualization and web mapping, most recently https://github.com/onthegomap/planetiler
What are some alternatives?
basemaps - Basemap PMTiles generation and cartographic styles for OpenStreetMap data and more
openmaptiles - OpenMapTiles Vector Tile Schema Implementation
go-pmtiles - Single-file executable tool for working with PMTiles archives
openmaptiles-tools - Tools to turn the schema into other formats
gpq - Utility for working with GeoParquet
tilemaker - Make OpenStreetMap vector tiles without the stack
serverlessmaps - Creating and hosting serverless maps
sequentially-generate-planet-mbtiles - Generate vector tiles for the entire planet on relatively low spec hardware.
tinygpkg-data - Small geographic datasets based on open data + tools
headway - Self-hostable maps stack, powered by OpenStreetMap.
gdal - GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats.
operations - OSMF Operations Working Group issue tracking