ZooKeeper-free Kafka is out. First Demo

• java-pubsublite-kafka

  4 8 0.0 Java
  

• Apache Kafka

  26 27,275 9.9 Java

  Mirror of Apache Kafka

  

Thanks for putting things in perspective, EdwardDiego.

> The fact that MM2 happened, and Confluent didn't try to stop it, despite it being awfully similar to Replicator, makes me think that Confluent are acting in good faith.

Let me share an anecdote related to this example. We (Confluent) were actually the ones who contributed the documentation for MirrorMaker v2 to the Apache Kafka docs (https://kafka.apache.org/documentation/#georeplication). The development lead on MM2 was (an engineer at) Cloudera, yet they never spent the time to provide user-facing documentation to the Kafka project. I don't want to speculate about reasons, yet I noticed that MM2 was documented in the Cloudera docs.

If we didn't care for the Kafka community at Confluent, we would not have spent our own resources and time to fill that gap, given that we have a proprietary product similar to MM2 (i.e., Confluent Replicator).

https://github.com/apache/kafka/pull/9983

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• styx

  4 60 0.0 Go

  Simple, high-performance event streaming broker

  

Hi Alexander ! I'm a big fan of the work you do at vectorizedio and of your blog posts ! I strongly believe there's a need for much simpler event streaming and room for improvement performance-wise.

I took a different path by divorcing from the Kafka protocol and experimenting with what I believe is a simpler to model approach to reliable event processing [1].

[1] https://github.com/dataptive/styx/blob/master/docs/howto/rel...

• jetstream

  2 428 8.4 Dockerfile

  Discontinued JetStream Utilities (by nats-io)

  

• liftbridge

  10 2,532 6.4 Go

  Lightweight, fault-tolerant message streams.

  

And if you want closer kafka semantics built on top of nats, check out liftbridge:

https://liftbridge.io/

• Jocko

  3 4,878 0.0 Go

  Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)

Reminded me of this project: https://github.com/travisjeffery/jocko

Kafka implemented in Go without needing Zookeeper.

• jepsen

  3 6,589 7.8 Clojure

  A framework for distributed systems verification, with fault injection

  

https://github.com/jepsen-io/jepsen/issues/399

> Yeah! I mean, I find a lot of linearizability errors in various databases, but this was also my very first time doing this kind of test, and it varies from system to system. Could have easily slipped through the cracks.

In summary, aphyr thought Zookeeper is linearizable even though it doesn't provide linearizable ops.

Looks like Zookeeper needs to be tested again.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• kafkacat

  8 3,573 7.3 C

  Discontinued Generic command line non-JVM Apache Kafka producer and consumer [Moved to: https://github.com/edenhill/kcat]

• Apache Pulsar

  30 13,727 9.8 Java

  Apache Pulsar - distributed pub-sub messaging system

  

As I know, Pulsar community is doing the work of removing ZooKeeper, this is a helpful link: https://github.com/apache/pulsar/projects/10

• redpanda

  69 8,734 10.0 C++

  Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

  

The BSL license makes choosing it "a discussion" versus using OSI licensed software: https://github.com/vectorizedio/redpanda/tree/v21.3.7/licens...

I don't have enough experience with these new vanity licenses to know what the contribution story looks like, either

Suggest a related project