Our great sponsors
Open source email automation written in Rust
That's it. Pigeon has some more handy features which you can check out on github and it is on crates.io as well.
A full featured, fast Command Line Argument Parser for Rust
Pigeon is a command line tool based on the excellent libraries clap, connectorx, and polars.
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
The Rust package registry
Finally, I think, a compiled binary is handy for command line tools. Admittedly, you have to compile it first, which will take some time. But then you can put ~/.cargo/bin to your PATH, install the latest version from crates.io via cargo install pigeon-rs, and use the binary from everywhere. In Python you would need an alias first because otherwise you would always have to type python3 path/to/python/file. And might have to worry that the command line arguments are piped to the python executable?
Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
Connectorx is using arrow2 data format for fetching from a database. This data format is optimized for columnar data :
Native PostgreSQL driver for the Rust programming language
The problem with a crate like postgres is that you have to define the types of the query at compile-time. And if you use the simple query protocol in postgres, you just get a bunch of strings, i.e. no proper typing at all. However, for maximal flexibility arbitrary queries should work in pigeon, without knowing the database schema.
Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
Holy Uck Fast Analysis with DuckDB and Pyarrow
3 projects | news.ycombinator.com | 30 Apr 2022
Any job processing framework like Spark but in Rust?
4 projects | reddit.com/r/dataengineering | 23 Mar 2023
Daft: The Distributed Python Dataframe
3 projects | reddit.com/r/Python | 23 Mar 2023
Query Real Time Data in Kafka Using SQL
7 projects | dev.to | 23 Mar 2023
Anyone have experience with Databend (local or cloud)?
1 project | reddit.com/r/dataengineering | 23 Mar 2023