-
That's it. Pigeon has some more handy features which you can check out on github and it is on crates.io as well.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
Pigeon is a command line tool based on the excellent libraries clap, connectorx, and polars.
-
Finally, I think, a compiled binary is handy for command line tools. Admittedly, you have to compile it first, which will take some time. But then you can put ~/.cargo/bin to your PATH, install the latest version from crates.io via cargo install pigeon-rs, and use the binary from everywhere. In Python you would need an alias first because otherwise you would always have to type python3 path/to/python/file. And might have to worry that the command line arguments are piped to the python executable?
-
Apache Arrow
Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
Connectorx is using arrow2 data format for fetching from a database. This data format is optimized for columnar data [1]:
-
The problem with a crate like postgres is that you have to define the types of the query at compile-time. And if you use the simple query protocol in postgres, you just get a bunch of strings, i.e. no proper typing at all. However, for maximal flexibility arbitrary queries should work in pigeon, without knowing the database schema.
Related posts
-
How moving from Pandas to Polars made me write better code without writing better code
-
Cap'n Proto 1.0
-
GlareDB: An open source SQL database to query and analyze distributed data
-
Holy Uck Fast Analysis with DuckDB and Pyarrow
-
Trailbase: Fast, single-file, open-source app server built using Rust and SQLite