Real Time Data Infra Stack

• elasticsearch-mapper-attachments

  102 503 0.0 Java

  Discontinued Mapper Attachments Type plugin for Elasticsearch

  

In general, there are two different approaches, one is to choose a common NoSQL database, such as MongoDB, ElasticSearch or Apache Cassandra. All of these NoSQL databases have good scalability and can support complex queries. In addition, these databases are very mature, so the learning curve is low for both use and operation.

• core

  283 44,481 9.8 TypeScript

  🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web. (by vuejs)

  

Vue.js

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• superset

  137 58,576 9.9 TypeScript

  Apache Superset is a Data Visualization and Data Exploration Platform

  

Apache Superset

• streamlit

  253 31,361 9.8 Python

  Streamlit — A faster way to build and share data apps.

  

Streamlit

• redpanda

  69 8,734 10.0 C++

  Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

  

Redpanda

• Redash

  38 24,917 9.5 Python

  Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

  

redash

• Memgraph

  44 2,074 9.6 C++

  Open-source graph database, built for real-time streaming data, compatible with Neo4j.

  

MEM GRAPH: Graph database built for real-time streaming and compatible with Neo4j

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• materialize

  117 5,558 10.0 Rust

  The data warehouse for operational workloads. (by MaterializeInc)

  

Even though these technical stacks are listed by category, some fields actually overlap. For example, although Materialize is classified as a stream processor, it makes sense to treat as a serving layer because it is essentially a streaming database, and the same is true for ksqlDB.

• ApacheKafka

  104 28 0.0

  A curated re-sources list for awesome Apache Kafka

The most common option is Kafka, but there are also various open source software and managed services. By the way, the following order does not represent the recommendation order.

• flink-statefun

  18 491 5.1 Java

  Apache Flink Stateful Functions

  

The Apache Flink, which is often mentioned, is one of these options, and there are many others.

• faust

  11 1,442 7.9 Python

  Python Stream Processing. A Faust fork (by faust-streaming)

  

Faust: Python framework

• Druid

  24 13,180 9.9 Java

  Apache Druid: a high performance real-time analytics database.

  

Apache Druid

• debezium

  80 9,843 9.9 Java

  Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

  

To capture data changes from these databases and deliver them to the stream platform, we often use Debezium.

• ClickHouse

  208 34,054 10.0 C++

  ClickHouse® is a free analytics DBMS for big data

  

ClickHouse

• beam

  30 7,477 10.0 Java

  Apache Beam is a unified programming model for Batch and Streaming data processing.

  

Apache Beam: Streaming framework which can be run on several runner such as Apache Flink and GCP Dataflow

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project