pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG. (by pathwaycom)

Pathway Alternatives

Similar projects and alternatives to pathway

  1. askai

    1,780 pathway VS askai

    Command Line Interface for OpenAi ChatGPT (by yudax42)

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. streamlit

    310 pathway VS streamlit

    Streamlit — A faster way to build and share data apps.

  4. hugo-quick-start

    Hugo Quick Start on Render

  5. ClickHouse

    ClickHouse® is a real-time analytics database management system

  6. ApacheKafka

    A curated re-sources list for awesome Apache Kafka

  7. materialize

    Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data. (by MaterializeInc)

  8. debezium

    89 pathway VS debezium

    Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  10. redpanda

    72 pathway VS redpanda

    Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

  11. Apache Pulsar

    Apache Pulsar - distributed pub-sub messaging system

  12. Druid

    26 pathway VS Druid

    Apache Druid: a high performance real-time analytics database.

  13. cocoindex

    Real-time data transformation framework for AI. Ultra performant, with incremental processing.

  14. llm-app

    15 pathway VS llm-app

    Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

  15. pinot

    19 pathway VS pinot

    Apache Pinot - A realtime distributed OLAP datastore

  16. pypath

    2 pathway VS pypath

    Python module for prior knowledge integration. Builds databases of signaling pathways, enzyme-substrate interactions, complexes, annotations and intercellular communication roles.

  17. makinage

    4 pathway VS makinage

    Stream Processing Made Easy

  18. finn

    4 pathway VS finn

    Dataflow compiler for QNN inference on FPGAs

  19. kafkatop

    Monitor kafka consumer lags and event rates

  20. arkflow

    High-performance Rust stream processing engine, providing powerful data stream processing capabilities, supporting multiple input/output sources and processors.

  21. SimpleCommand

    A simple, standardized way to build and use Service Objects (aka Commands) in Ruby

  22. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better pathway alternative or higher similarity.

pathway discussion

Log in or Post with

pathway reviews and mentions

Posts with mentions or reviews of pathway. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2025-04-01.
  • pathway VS cocoindex - a user suggested alternative
    2 projects | 1 Apr 2025
  • ArkFlow – High-performance Rust stream processing engine
    5 projects | news.ycombinator.com | 13 Mar 2025
  • Show HN: Pathway – Build Mission Critical ETL and RAG in Python (NATO, F1 Used)
    3 projects | news.ycombinator.com | 13 Jun 2024
    The main factor impacting the RAM requirement of the instance is the size of the data that you feed into it, especially if you need an in-memory index. (If you are curious about peak memory use etc., you can profile Pathway memory use in Grafana: https://github.com/pathwaycom/pathway/tree/main/examples/pro....)

    One point to clarify is that "Pathway Community" is self-hosted, and the "8GB RAM - 4 cores" value is just a limit on the dimension of your own/cloud machine that the framework will effectively use. Currently, if you would like to get a "free" cloud machine to go with your project, we suggest going for "Pathway Scale" and reaching out through the #Developer Assist link - add a mention that you are interested in cloud credits. You can also go with 3rd party hosting providers like http://render.com/ who have a (somewhat modest) free tier for Docker instances, or reasonably priced ones like fly.io https://fly.io/docs/about/pricing/.

  • Choosing Between a Streaming Database and a Stream Processing Framework in Python
    10 projects | dev.to | 10 Feb 2024
    We understood how streaming databases differ from traditional databases, stream processing engines, conventional analytics databases, or OLAP databases. Now let’s focus on when and why we can use stream data processing frameworks for Python as an alternative to streaming databases. Python is the go-to language for data science and machine learning. There are some stream-processing libraries and frameworks in Python such as Bytewax, Quix, GlassFlow, Pathway. They have been developed to cope with the challenges Python Engineers face with Apache Kafka or Flink since they do not natively support Python.
  • How to build a custom GPT enabled full-stack app for real-time data
    5 projects | dev.to | 5 Sep 2023
    Maintain a data snapshot to observe variations in sales prices over time, as Pathway provides a built-in feature to compute differences between two alterations.
  • Show HN: LLM App – build a realtime LLM app in 30 lines, with no vector database
    3 projects | news.ycombinator.com | 27 Jul 2023
    Pathway (https://github.com/pathwaycom/pathway) is a data processing framework we are developing that unifies stream and batch processing of large datasets. It lets developers concentrate on writing the data processing logic, without worrying about tracking changes to data and updating the results. The same code can then be run on batch data (e.g. during testing) or on real-time data streams (i.e. online query processing)

    In the LLM app, Pathway allows concentrating on prompt building and querying the LLM APIs as if the corpus of documents were static, while all updates to it are handled by the framework itself.

  • A note from our sponsor - SaaSHub
    www.saashub.com | 19 May 2025
    SaaSHub helps you find the best software and product alternatives Learn more →

Stats

Basic pathway repo stats
7
24,669
9.8
4 days ago

Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com

Did you know that Python is
the 2nd most popular programming language
based on number of references?