How to pass dataframes between Rust and Python?

This page summarizes the projects mentioned and recommended in the original post on reddit.com/r/rust

Our great sponsors
  • OPS - Build and Run Open Source Unikernels
  • Scout APM - Less time debugging, more time building
  • SonarLint - Deliver Cleaner and Safer Code - Right in Your IDE of Choice!
  • GitHub repo polars

    Fast multi-threaded DataFrame library in Rust | Python | Node.js

    It's working for me now. :-) To get it working, I used the code from the suggested directory as well as the class PyPolarsError, which I copied into a local module: https://github.com/pola-rs/polars/tree/master/py-polars/src/arrow_interop https://github.com/pola-rs/polars/blob/629f5012bcefaa3c9a9c1a236e64dc057e8d472c/py-polars/src/error.rs Besides the polars dependency, also these are needed:

  • GitHub repo arrow-datafusion

    Apache Arrow DataFusion and Ballista query engines

    A solution for either Polars or Datafusion (or something else?) would be fine. For both libraries, python packages exist, that contain the python bindings: https://github.com/pola-rs/polars/tree/master/py-polars https://github.com/apache/arrow-datafusion/tree/master/python

  • OPS

    OPS - Build and Run Open Source Unikernels. Quickly and easily build and deploy open source unikernels in tens of seconds. Deploy in any language to any cloud.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts