Stream processing framework for a new project in Python

This page summarizes the projects mentioned and recommended in the original post on /r/dataengineering
hardware-buttons linkedin-bot template-engine-js

Sevalla - Deploy and host your apps and databases, now with $50 credit!
Sevalla is the PaaS you have been looking for! Advanced deployment pipelines, usage-based pricing, preview apps, templates, human support by developers, and much more!
sevalla.com
featured
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com
featured

  1. bytewax

    Python Stream Processing

    Disclaimer: I work on Bytewax, but it feels like this could be a good fit and would save you some time looking around. If you need to do stateful operations (reduce, window, etc.) then you can use bytewax - https://github.com/bytewax/bytewax with pub/sub, but you would need to build a custom connector. There are some guides on how to do that - https://www.bytewax.io/blog/custom-input-connector.

  2. Sevalla

    Deploy and host your apps and databases, now with $50 credit! Sevalla is the PaaS you have been looking for! Advanced deployment pipelines, usage-based pricing, preview apps, templates, human support by developers, and much more!

    Sevalla logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • A Python package for streaming synthetic data

    2 projects | /r/Python | 25 May 2023

  • Snowflake - what are the streaming capabilities it provides?

    3 projects | /r/dataengineering | 10 May 2023

  • Roast my new Python library for stream processing

    1 project | news.ycombinator.com | 3 Apr 2025

  • Show HN: Bytewax, JVM free stream processing Py+Rust

    1 project | news.ycombinator.com | 17 Oct 2024

  • Building a streaming SQL engine with Arrow and DataFusion

    1 project | news.ycombinator.com | 18 Mar 2024
Loading...