Top 11 Rust Pipeline Projects

vector

96 16,427 9.9 Rust

A high-performance observability data pipeline.

Project mention: Docker Log Observability: Analyzing Container Logs in HashiCorp Nomad with Vector, Loki, and Grafana | dev.to | 2024-04-19

job "vector" { datacenters = ["dc1"] # system job, runs on all nodes type = "system" group "vector" { count = 1 network { port "api" { to = 8686 } } ephemeral_disk { size = 500 sticky = true } task "vector" { driver = "docker" config { image = "timberio/vector:0.30.0-debian" ports = ["api"] volumes = ["/var/run/docker.sock:/var/run/docker.sock"] } env { VECTOR_CONFIG = "local/vector.toml" VECTOR_REQUIRE_HEALTHY = "false" } resources { cpu = 100 # 100 MHz memory = 100 # 100MB } # template with Vector's configuration template { destination = "local/vector.toml" change_mode = "signal" change_signal = "SIGHUP" # overriding the delimiters to [[ ]] to avoid conflicts with Vector's native templating, which also uses {{ }} left_delimiter = "[[" right_delimiter = "]]" data=<

prql

106 9,427 9.9 Rust

PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement

Project mention: Prolog language for PostgreSQL proof of concept | news.ycombinator.com | 2024-03-30

InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
paradedb

16 3,803 9.8 Rust

Postgres for Search and Analytics

Project mention: Using ClickHouse to scale an events engine | news.ycombinator.com | 2024-04-11

rust-subprocess

2 413 0.0 Rust

Execution of and interaction with external processes and pipelines
pipelight

8 265 9.3 Rust

Tiny automation pipelines. Bring CI/CD to the smallest projects. Self-hosted, Lightweight, CLI only.

Project mention: Pipelight: Tiny Automation Pipelines | news.ycombinator.com | 2024-01-26

smag

3 122 7.4 Rust

Show Me A Graph - Command Line Graphing
ppl

2 62 9.3 Rust

Parallelo Parallel Library (PPL) is a small parallel framework that brings Structured Parallel Programming in Rust. (by valebes)

Project mention: Parallelo Parallel Library (PPL): A small parallel framework in Rust | news.ycombinator.com | 2023-06-11

WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
pipecolor

1 52 8.3 Rust

A terminal filter to colorize output
pipe-trait

1 39 0.6 Rust

Make it possible to chain regular functions
naps

3 9 3.6 Rust

chain nats servers with transformation & processing pipelines
chained

1 1 3.7 Rust

A Rust library for lazily chaining functions

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).