Rust Kafka

Open-source Rust projects categorized as Kafka | Edit details

Top 8 Rust Kafka Projects

  • GitHub repo materialize

    Materialize simplifies application development with streaming data. Incrementally-updated materialized views - in PostgreSQL and in real time. Materialize is powered by Timely Dataflow. (by MaterializeInc)

    Project mention: Tricking PostgreSQL into using an insane – but 200x faster – query plan | reddit.com/r/programming | 2022-01-18

    Alternatively, you can install Materialize, configure change data capture to stream the relevant data to it and then write this query as a live view that gets instantly and incrementally updated instead of performing it periodically.

  • GitHub repo Ockam

    End-to-end encryption and mutual authentication for distributed applications.

    Project mention: Official /r/rust "Who's Hiring" thread for job-seekers and job-offerers [Rust 1.58] | reddit.com/r/rust | 2022-01-13

    Ockam crates implement a collection of messaging and cryptographic protocols that provide end-to-end application layer trust in data. We believe that, in order to have a realistically manageable vulnerability surface, all modern applications need end-to-end guarantees of data integrity and authenticity. The only way to build secure and private applications is to remove unnecessary implicit trust in network boundaries, intermediaries and infrastructure.

  • Scout APM

    Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.

  • GitHub repo rust-rdkafka

    A fully asynchronous, futures-based Kafka client library for Rust based on librdkafka

    Project mention: Hey Rustaceans! Got an easy question? Ask here (46/2021)! | reddit.com/r/rust | 2021-11-15

    I am playing with tokio and rust-rdkafka library, following the examples like this one: https://github.com/fede1024/rust-rdkafka/blob/6fb2c37/examples/asynchronous_processing.rs

  • GitHub repo kafka-rust

    Rust client for Apache Kafka

    Project mention: Is there an alternative to Kafka that has better support in Rust? | reddit.com/r/rust | 2021-04-17

    I browsed through it and the feedback in the issues seemed to indicate it was idle but a new maintainer had stepped up. Issues like this make me question the direction of it though. I'm not knocking the maintainer, I've been in situations where disabling tests seemed like a good idea, but you learn from experience that's more often than not, with the caveat of major refactors, an indication of either a systemic problem or lack of comprehension on the project as a whole..

  • GitHub repo flowgger

    A fast data collector in Rust

  • GitHub repo pq

    a command-line Protobuf parser with Kafka support and JSON output (by sevagh)

    Project mention: Podman: A Daemonless Container Engine | news.ycombinator.com | 2021-02-11

    I have a Makefile for a Rust project which binds the local repository to a Docker volume, builds it in the container using muslrust, and then does a chown to change the target directory back from root ownership to my own user.

    All I had to do was 's/docker/podman/g' and remove the chown hack and it works fine: https://github.com/sevagh/pq/commit/6acf6d05a094ac2959567a9a...

    It understands Dockerfiles and can pull images from Dockerhub.

  • GitHub repo kafka-delta-ingest

    A highly efficient daemon for streaming data from Kafka into Delta Lake

    Project mention: Exactly once delivery from Kafka to Delta Lake with Rust | news.ycombinator.com | 2021-09-15
  • SonarQube

    Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.

  • GitHub repo rust-kafka-101

    Getting started with Rust and Kafka

    Project mention: Getting started with Kafka and Rust: Part 2 | dev.to | 2021-04-14

    git clone https://github.com/abhirockzz/rust-kafka-101 cd part2

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-01-18.

Rust Kafka related posts

Index

What are some of the best open-source Kafka projects in Rust? This list will help you:

Project Stars
1 materialize 3,476
2 Ockam 1,785
3 rust-rdkafka 818
4 kafka-rust 682
5 flowgger 661
6 pq 135
7 kafka-delta-ingest 101
8 rust-kafka-101 0
Find remote jobs at our new job board 99remotejobs.com. There are 29 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
OPS - Build and Run Open Source Unikernels
Quickly and easily build and deploy open source unikernels in tens of seconds. Deploy in any language to any cloud.
github.com/nanovms