Rust Streaming

Open-source Rust projects categorized as Streaming

Top 23 Rust Streaming Projects

  1. asciinema

    Terminal session recorder, streamer and player πŸ“Ή

    Project mention: Asciline – real-time ASCII video rendering engine | news.ycombinator.com | 2026-06-11
  2. AppSignal

    AppSignal knows why the f*#k it crashed. Stop vibe-debugging. Every exception, every backtrace, grouped so you see patterns, not noise.

    AppSignal logo
  3. materialize

    The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL (by MaterializeInc)

    Project mention: ANN v3: 200ms p99 query latency over 100B vectors | news.ycombinator.com | 2026-01-25

    I agree our sample may not be representative but we try to stay focused on the current and next crop of tpuf customers. So far "CI prohibits network access during tests" just hasn't come up as a pain point for any of them, but as I mentioned in another comment [0], we're definitely keeping an open mind about introducing an offline dev experience.

    At my last company an engineer spent a year implementing Bazel [0][1] only to have it ripped out after they left [2] due to the maintenance burden. You might say it was a little bit of a hassle. :)

    [0]: https://news.ycombinator.com/item?id=46758156

    [1]: https://github.com/MaterializeInc/materialize/pull/24243

    [2]: https://github.com/MaterializeInc/materialize/pull/31006

    [3]: https://github.com/MaterializeInc/materialize/pull/33895

  4. fluvio

    πŸ¦€ event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

  5. iggy

    Apache Iggy: Hyper-Efficient Message Streaming at Laser Speed

    Project mention: IBM to Acquire Confluent | news.ycombinator.com | 2025-12-08

    Apache Iggy seems like a project with a lot of momentum: https://github.com/apache/iggy

  6. pushpin

    A proxy server for adding push to your API, used at the core of Fastly's Fanout service

  7. feldera

    The Feldera Incremental Computation Engine

    Project mention: Clean code in the age of coding agents | news.ycombinator.com | 2026-04-09

    our CLAUDE.md / AGENTS.md specifically calls out good engineering books, which I think does help:

    From https://github.com/feldera/feldera/blob/main/CLAUDE.md:

    - Adhere to rules in "Code Complete" by Steve McConnell.

    - Adhere to rules in "The Art of Readable Code" by Dustin Boswell & Trevor Foucher.

    - Adhere to rules in "Bugs in Writing: A Guide to Debugging Your Prose" by Lyn Dupre.

    - Adhere to rules in "The Elements of Style, Fourth Edition" by William Strunk Jr. & E. B. White

    e.g., mentioning Elements of Style and Bugs in Writing certainly has helped our review LLM to make some great suggestions about English documentation PRs in the past.

  8. lol-html

    Low output latency streaming HTML parser/rewriter with CSS selector-based API

  9. Kargo

    Stop Scripting Promotions. Start Shipping with Kargo. Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.

    Kargo logo
  10. robustmq

    Communication infrastructure for the AI era β€” one binary, one broker, one storage layer, any protocol

  11. dozer

    Dozer is a real-time data movement tool that leverages CDC from various sources and moves data into various sinks. (by getdozer)

  12. dash-mpd-cli

    Download media content from a DASH-MPEG or DASH-WebM MPD manifest

  13. nginx-obs-automatic-low-bitrate-switching

    Simple app to automatically switch scenes in OBS based on the current bitrate fetched from the ingest stats page.

  14. plock

    From anywhere you can type, query and stream the output of any script (e.g. an LLM)

  15. wick

    Functional, reactive WebAssembly with a twist

  16. scuffle

    Opensource Cloud Provider (focusing on video streaming)

  17. picomq

    Durable streams on object storage

    Project mention: Show HN: PicoMQ – Durable Streams over HTTP, on object storage | news.ycombinator.com | 2026-08-24

    I'm surprised nobody asked this yet. I'll start by saying that the number of streams and the throughput a single node can vertically scale to covers the majority of use cases, but that's not a good enough answer.

    PicoMQ supports multi-node/cluster-mode, in which every node in the cluster has "slots." When you create/register a new stream, placement picks the node with the lowest load relative to its slot capacity, so ownership lands on whoever has the most free capacity.

    But that alone wouldn't answer auto-scaling and rebalancing. Pico also makes transferring ownership quite cheap (data never moves, only a metadata pointer changes), so it's very feasible to rebalance or add nodes. New nodes automatically attract newly created streams, since an empty node scores lowest on load-per-slot. In addition, rebalancing existing streams across nodes helps with skew.

    What doesn't exist today is automatic rebalancing and scaling in/out, but PicoMQ has all the primitives to support it.

    As for the WAL: recovery is bounded by the uncompacted WAL residency, not by stream size, and the compaction frequency is configurable (by time or size). Recovery runs once at node startup, before the node serves traffic, so consumers never see a per-request replay stall. The cost is folded into boot time and amounts to an S3 List + replaying whatever was written since the last compaction (typically seconds of writes). A planned scale-down flushes all buffered data on shutdown, so cleanly stopped node restarts with nothing to replay. The replay cost only applies after crashes, and crash-failover onto a surviving node pays the same bounded cost through a foreign-WAL recovery path.

    A related planned feature: https://github.com/PicoMQ/picomq/issues/12

  18. atm0s-media-server

    Decentralized, Global-Scale Media Server written in Rust (WebRTC/Whip/Whep/Rtmp/Sip)

  19. liter-llm

    Universal LLM API client β€” 163 providers, 14 native language bindings, powered by a Rust core

    Project mention: Show HN: Liter-LLM, Universal LLM client in Rust with bindings for 11 languages | news.ycombinator.com | 2026-03-29
  20. volga

    Unified real-time data engine

  21. lunchpad

    A macro application for Novation Launchpads - easy to use, feature rich

  22. busbar

    The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream actionβ€”while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.

    Project mention: Show HN: Busbar – every LLM behind one URL, in a single Rust binary | news.ycombinator.com | 2026-06-05
  23. logu

    Extract patterns from unstructured log messages

  24. xml-rs

    xml-rs is an XML library for the Rust programming language. It supports reading and writing of XML documents in a streaming fashion (without DOM). (by kornelski)

    Project mention: xml-rs VS xml-rs - a user suggested alternative | libhunt.com/r/xml-rs | 2025-10-24

    xml-rs has a new home: https://github.com/kornelski/xml-rs.

  25. YAKC

    Yet Another Key Caster β€” a fast, native, cross-platform key & mouse click visualizer for streamers, presenters and developers. Built with Rust + Tauri.

  26. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust Streaming discussion

Log in or Post with

Rust Streaming related posts

Index

What are some of the best open-source Streaming projects in Rust? This list will help you:

# Project Stars
1 asciinema 17,789
2 materialize 6,368
3 fluvio 5,253
4 iggy 4,853
5 pushpin 3,856
6 feldera 2,085
7 lol-html 2,066
8 robustmq 1,796
9 dozer 1,577
10 dash-mpd-cli 558
11 nginx-obs-automatic-low-bitrate-switching 506
12 plock 504
13 wick 476
14 scuffle 418
15 picomq 350
16 atm0s-media-server 329
17 liter-llm 252
18 volga 161
19 lunchpad 153
20 busbar 142
21 logu 122
22 xml-rs 118
23 YAKC 104

Sponsored
AppSignal knows why the f*#k it crashed.
Stop vibe-debugging. Every exception, every backtrace, grouped so you see patterns, not noise.
www.appsignal.com

Did you know that Rust is
the 3rd most popular programming language
based on number of references?