Using Rust to write a Data Pipeline. Thoughts. Musings.

This page summarizes the projects mentioned and recommended in the original post on /r/rust
Rust Arrow SQL Dataframe cloud-native

InfluxDB
Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • arrow-datafusion

    Apache DataFusion SQL Query Engine

  • differential-dataflow

    An implementation of differential dataflow using timely dataflow on Rust.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • roapi

    Create full-fledged APIs for slowly moving datasets without writing a single line of code.

  • polars

    Dataframes powered by a multithreaded, vectorized query engine, written in Rust

  • fluvio

    Lean and mean distributed stream processing system written in rust and web assembly.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts