firehose
transit
| firehose | transit | |
|---|---|---|
| 3 | 1 | |
| 312 | 6 | |
| 0.0% | - | |
| 2.5 | 0.0 | |
| 10 months ago | 12 days ago | |
| Java | Zig | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
firehose
-
Modern open-source data platform that empowers organizations to discover, transform, analyse and secure data faster and efficiently.
Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.
- Firehose: Ingest streaming data to various sinks like HTTP REST, GRPC, and various databases. Firehose on daily basis ingest billions of events to our data warehouses and other storage systems. It is Open Source. Check it out and shoot us a star.
- No-Code Kafka sink to stream Protobuf/JSON data
transit
-
Kafka Is Dead, Long Live Kafka
This is super interesting @richieartoul. I specced out something similar myself and was going to implement it in Zig https://github.com/fremantle-industries/transit.
FWIW I came to a similar conclusion that a lot of the power in Kafka comes from the API and that eventually much of the complexity of managing the cluster will eventually be abstracted away with multiple implementations. I also felt that if I could implement Kafka persistent over the S3 keyspace then I could start with persistence direct to S3 like you've done with warpstream and then layer on a faster hot disk and in memory tiering mechanism to eventually lower end to end latencies.
I love where you're going with this so hit me up on twitter if you ever want to chat more in-depth https://twitter.com/rupurt.
What are some alternatives?
kafka-connect-cosmosdb - Kafka Connect connectors for Azure Cosmos DB
Event Store - EventStoreDB, the event-native database. Designed for Event Sourcing, Event-Driven, and Microservices architectures
kafka-connect-jdbc - Kafka Connect connector for JDBC-compatible databases
kafta - Kafta is a command line for managing Kafka clusters
mongo-kafka - MongoDB Kafka Connector
tiered-storage-for-apache-kafk
kafka-streams-in-action - Source code for the Kafka Streams in Action Book
Apache Pulsar - Apache Pulsar - distributed pub-sub messaging system
Apache Kafka - Mirror of Apache Kafka
redpanda - Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
siren - Siren provides an easy-to-use universal alert, notification, channels management framework for the entire observability infrastructure.
tiered-storage-for-apache-kafka - RemoteStorageManager for Apache Kafka® Tiered Storage