duckdb_fdw
geoparquet
Our great sponsors
duckdb_fdw | geoparquet | |
---|---|---|
4 | 3 | |
235 | 719 | |
- | 5.0% | |
7.3 | 5.5 | |
2 months ago | 5 days ago | |
PLpgSQL | Python | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
duckdb_fdw
- Querying Postgres Tables Directly from DuckDB
- Postgres and Parquet in the Data Lke
-
DuckDB quacks Arrow: A zero-copy data integration between Arrow and DuckDB
I should also add that there is a duckdb fdw, so you could have DuckDB read from your parquet files and do faster transformations before you pull your data into Postgres!
https://github.com/alitrack/duckdb_fdw
- DuckDB Postgres Foreign Data Wrapper
geoparquet
-
Friends don't let friends export to CSV
That's why I'm working on the GeoParquet spec [0]! It gives you both compression-by-default and super fast reads and writes! So it's usually as small as gzipped CSV, if not smaller, while being faster to read and write than GeoPackage.
Try using `GeoDataFrame.to_parquet` and `GeoPandas.read_parquet`
[0]: https://github.com/opengeospatial/geoparquet
-
COMTiles (Cloud Optimized Map Tiles) hosted on Amazon S3 and Visualized with MapLibre GL JS
GeoParquet
-
Postgres and Parquet in the Data Lke
> "Generating Parquet"
It is also useful for moving data from Postgres to BigQuery! ( batch load )
https://cloud.google.com/bigquery/docs/loading-data-cloud-st...
Thanks for the "ogr2ogr" trick! :-)
I hope the next blog post will be about GeoParquet and storing complex geometries in parquet format :-)
https://github.com/opengeospatial/geoparquet
What are some alternatives?
subzero-starter-kit - Starter Kit and tooling for authoring GraphQL/REST API backends with subZero
mbtiles-spec - specification documents for the MBTiles tileset format
odbc2parquet - A command line tool to query an ODBC data source and write the result into a parquet file.
aquameta - Web development platform built entirely in PostgreSQL
geemap - A Python package for interactive geospatial analysis and visualization with Google Earth Engine.
postgres_vectorization_test - Vectorized executor to speed up PostgreSQL
flatgeobuf - A performant binary encoding for geographic data based on flatbuffers
parquet_fdw - Parquet foreign data wrapper for PostgreSQL
parquet_s3_fdw - ParquetS3 Foreign Data Wrapper for PostgresSQL
BlenderGIS - Blender addons to make the bridge between Blender and geographic data