parquet_fdw
duckdb_fdw
Our great sponsors
parquet_fdw | duckdb_fdw | |
---|---|---|
2 | 4 | |
316 | 235 | |
7.0% | - | |
2.7 | 7.3 | |
7 days ago | about 2 months ago | |
C++ | PLpgSQL | |
PostgreSQL License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
parquet_fdw
duckdb_fdw
- Querying Postgres Tables Directly from DuckDB
- Postgres and Parquet in the Data Lke
-
DuckDB quacks Arrow: A zero-copy data integration between Arrow and DuckDB
I should also add that there is a duckdb fdw, so you could have DuckDB read from your parquet files and do faster transformations before you pull your data into Postgres!
https://github.com/alitrack/duckdb_fdw
- DuckDB Postgres Foreign Data Wrapper
What are some alternatives?
odbc2parquet - A command line tool to query an ODBC data source and write the result into a parquet file.
subzero-starter-kit - Starter Kit and tooling for authoring GraphQL/REST API backends with subZero
geoparquet - Specification for storing geospatial vector data (point, line, polygon) in Parquet
cstore_fdw - Columnar storage extension for Postgres built as a foreign data wrapper. Check out https://github.com/citusdata/citus for a modernized columnar storage implementation built as a table access method.
aquameta - Web development platform built entirely in PostgreSQL
postgres_vectorization_test - Vectorized executor to speed up PostgreSQL
delta - An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
parquet_s3_fdw - ParquetS3 Foreign Data Wrapper for PostgresSQL