parquet2 vs odbc2parquet

parquet2

Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow (by jorgecarleitao)

Source Code

Suggest alternative

Edit details

odbc2parquet

A command line tool to query an ODBC data source and write the result into a parquet file. (by pacman82)

Odbc Parquet

Source Code

Suggest alternative

Edit details

Our great sponsors

WorkOS - The modern identity platform for B2B SaaS

InfluxDB - Power Real-Time Data Analytics at Scale

SaaSHub - Software Alternatives and Reviews

Our great sponsors

parquet2		odbc2parquet
	Project
6	Mentions	5
347	Stars	204
-	Growth	-
3.2	Activity	9.3
7 months ago	Latest Commit	3 days ago
Rust	Language	Rust
GNU General Public License v3.0 or later	License	MIT License

The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

parquet2

Posts with mentions or reviews of parquet2. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-10-04.

Rust is showing a lot of promise in the DataFrame / tabular data space
9 projects | /r/rust | 4 Oct 2022

[arrow2](https://github.com/jorgecarleitao/arrow2) and [parquet2](https://github.com/jorgecarleitao/parquet2) are great foundational libraries for and DataFrame libs in Rust.
::lending-iterator — Lending/streaming Iterators on Stable Rust (and a pinch of HKT)
3 projects | /r/rust | 20 Jul 2022

This is so freaking life-saving! - we have been using StreamingIterator and FallibleStreamingIterator in libraries (arrow2 and parquet2) and the existing landscape is quite confusing for new users!
Anda para aqui alguém a brincar com Rust (linguagem)?
4 projects | /r/devpt | 9 May 2022
Parquet2 0.9 released (and a request for feedback)
2 projects | /r/rust | 11 Jan 2022

Thanks a lot for your feedback. Based on it I am proposing the following change: https://github.com/jorgecarleitao/parquet2/pull/78
parquet2 0.3.0, with native support to read async
3 projects | /r/rust | 9 Aug 2021

release on github.

odbc2parquet

Posts with mentions or reviews of odbc2parquet. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-05-03.

Postgres and Parquet in the Data Lke
7 projects | news.ycombinator.com | 3 May 2022
MySQL table data to direct parquet output
1 project | /r/dataengineering | 14 Apr 2022

Although, I found a GitHub page (odbc2parquet) which can export the table (also a query output) to parquet.
Parquet best practices
2 projects | /r/dataengineering | 11 Feb 2022

Is this a one-time task? Maybe check out ODBC2PARQUET https://github.com/pacman82/odbc2parquet
Thoughts on Using Airbyte to read/write to S3?
1 project | /r/dataengineering | 31 Jan 2022

I tried writing parquet to s3 with Airbyte a few months ago and gave up. It was extremely slow for small tables and would not work at all for larger tables. I wound up using this https://github.com/pacman82/odbc2parquet + aws cli
Extract data from ERP systems to Snowflake - Which tools (besides Airbyte)?
1 project | /r/dataengineering | 26 Jan 2022

Yes, I have been tinkering around with odbc2parquet (https://github.com/pacman82/odbc2parquet) and storing it in a variant column. For the dependency/workflow management maybe prefect

What are some alternatives?

When comparing parquet2 and odbc2parquet you can also consider the following projects:

parquet-format-rs - Apache Parquet format for Rust, hosting the Thrift definition file and the generated .rs file

sql-spark-connector - Apache Spark Connector for SQL Server and Azure SQL

rust-brotli - Brotli compressor and decompressor written in rust that optionally avoids the stdlib

roapi - Create full-fledged APIs for slowly moving datasets without writing a single line of code.

sqlpad - Web-based SQL editor. Legacy project in maintenance mode.

arrow2 - Transmute-free Rust library to work with the Arrow format

geoparquet - Specification for storing geospatial vector data (point, line, polygon) in Parquet

inkwell - It's a New Kind of Wrapper for Exposing LLVM (Safely)

duckdb_fdw - DuckDB Foreign Data Wrapper for PostgreSQL

pqrs - Command line tool for inspecting Parquet files

cstore_fdw - Columnar storage extension for Postgres built as a foreign data wrapper. Check out https://github.com/citusdata/citus for a modernized columnar storage implementation built as a table access method.