Using Polars in Rust for high-performance data analysis

This page summarizes the projects mentioned and recommended in the original post on dev.to

SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  1. axum

    Ergonomic and modular web framework built with Tokio, Tower, and Hyper

    We’ll use Axum with Tokio to build a web backend, Tracing for logging, and Serde for serialization and deserialization.

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  3. tracing

    Application level tracing for Rust.

    We’ll use Axum with Tokio to build a web backend, Tracing for logging, and Serde for serialization and deserialization.

  4. rust-polars-example

    A basic example of using polars to build a data analysis pipeline exposed via REST in Rust

    You can find the full code for this example on GitHub (this doesn’t include the data files — you’ll have to fetch them on your own from the links mentioned below).

  5. tokio

    A runtime for writing reliable asynchronous applications with Rust. Provides I/O, networking, scheduling, timers, ...

    We’ll use Axum with Tokio to build a web backend, Tracing for logging, and Serde for serialization and deserialization.

  6. serde

    Serialization framework for Rust

    We’ll use Axum with Tokio to build a web backend, Tracing for logging, and Serde for serialization and deserialization.

  7. Pandas

    Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more

    One of the main selling points of Polars over similar solutions such as Pandas is performance. Polars is written in highly optimized Rust and uses the Apache Arrow container format.

  8. polars

    Dataframes powered by a multithreaded, vectorized query engine, written in Rust

    If you want to get into Polars, the library is very well documented, and I’d recommend you check out their getting started tutorial, their API docs, and when you’re all set up, you can also check out their Cookbooks to learn about many of the standard operations within Polars.

  9. libcurl

    A command line tool and library for transferring data with URL syntax, supporting DICT, FILE, FTP, FTPS, GOPHER, GOPHERS, HTTP, HTTPS, IMAP, IMAPS, LDAP, LDAPS, MQTT, POP3, POP3S, RTMP, RTMPS, RTSP, SCP, SFTP, SMB, SMBS, SMTP, SMTPS, TELNET, TFTP, WS and WSS. libcurl offers a myriad of powerful features

    We’ll start the server using the RUST_LOG=info cargo run command and send requests to it using curl.

  10. Apache Arrow

    Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

    One of the main selling points of Polars over similar solutions such as Pandas is performance. Polars is written in highly optimized Rust and uses the Apache Arrow container format.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Why you should keep an eye on Apache DataFusion and its community.

    4 projects | dev.to | 8 Jul 2024
  • How moving from Pandas to Polars made me write better code without writing better code

    2 projects | dev.to | 5 Mar 2024
  • Polars

    11 projects | news.ycombinator.com | 8 Jan 2024
  • Any job processing framework like Spark but in Rust?

    4 projects | /r/dataengineering | 23 Mar 2023
  • I Could Rewrite Curl

    3 projects | news.ycombinator.com | 20 Mar 2023

Did you know that Rust is
the 5th most popular programming language
based on number of references?