parquet_fdw
geoparquet
Our great sponsors
parquet_fdw | geoparquet | |
---|---|---|
2 | 3 | |
316 | 719 | |
7.0% | 5.0% | |
2.7 | 5.5 | |
7 days ago | 4 days ago | |
C++ | Python | |
PostgreSQL License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
parquet_fdw
geoparquet
-
Friends don't let friends export to CSV
That's why I'm working on the GeoParquet spec [0]! It gives you both compression-by-default and super fast reads and writes! So it's usually as small as gzipped CSV, if not smaller, while being faster to read and write than GeoPackage.
Try using `GeoDataFrame.to_parquet` and `GeoPandas.read_parquet`
[0]: https://github.com/opengeospatial/geoparquet
-
COMTiles (Cloud Optimized Map Tiles) hosted on Amazon S3 and Visualized with MapLibre GL JS
GeoParquet
-
Postgres and Parquet in the Data Lke
> "Generating Parquet"
It is also useful for moving data from Postgres to BigQuery! ( batch load )
https://cloud.google.com/bigquery/docs/loading-data-cloud-st...
Thanks for the "ogr2ogr" trick! :-)
I hope the next blog post will be about GeoParquet and storing complex geometries in parquet format :-)
https://github.com/opengeospatial/geoparquet
What are some alternatives?
odbc2parquet - A command line tool to query an ODBC data source and write the result into a parquet file.
mbtiles-spec - specification documents for the MBTiles tileset format
duckdb_fdw - DuckDB Foreign Data Wrapper for PostgreSQL
cstore_fdw - Columnar storage extension for Postgres built as a foreign data wrapper. Check out https://github.com/citusdata/citus for a modernized columnar storage implementation built as a table access method.
geemap - A Python package for interactive geospatial analysis and visualization with Google Earth Engine.
postgres_vectorization_test - Vectorized executor to speed up PostgreSQL
flatgeobuf - A performant binary encoding for geographic data based on flatbuffers
delta - An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
BlenderGIS - Blender addons to make the bridge between Blender and geographic data
com-tiles - Streamable and read optimized file archive for hosting map tiles at global scale on a cloud object storage