Fluent-plugin-kafka Alternatives

Similar projects and alternatives to fluent-plugin-kafka

Scio

7 2,520 9.6 Scala fluent-plugin-kafka VS Scio

A Scala API for Apache Beam and Google Cloud Dataflow.
secor

3 1,834 0.0 Java fluent-plugin-kafka VS secor

Secor is a service implementing Kafka log persistence
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
fluent-plugin-throttle

1 41 0.0 Ruby fluent-plugin-kafka VS fluent-plugin-throttle

Rate limiting for fluentd
fluent-plugin-rewrite-tag-filter

1 168 3.0 Ruby fluent-plugin-kafka VS fluent-plugin-rewrite-tag-filter

Fluentd Output filter plugin to rewrite tags that matches specified attribute.
fluent-plugin-http-pull

1 22 5.0 Ruby fluent-plugin-kafka VS fluent-plugin-http-pull

The input plugin of fluentd to pull log from rest api.
kafkat

1 503 0.0 Ruby fluent-plugin-kafka VS kafkat

KafkaT-ool
rdkafka-ruby

1 321 8.7 Ruby fluent-plugin-kafka VS rdkafka-ruby

Modern and performant Kafka client library for Ruby based on librdkafka
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better fluent-plugin-kafka alternative or higher similarity.

Suggest an alternative to fluent-plugin-kafka

fluent-plugin-kafka reviews and mentions

Posts with mentions or reviews of fluent-plugin-kafka. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-01-01.

ELT, Data Pipeline
4 projects | dev.to | 1 Jan 2021

Before we moved to using the data from Kafka, we kept it running as our secondary datasource imported in to Big Query to compare the data count. The data count seemed to be better coming from Kafka indicating that we were losing some data via our S3 based pipeline. As we started adding more and more datasets to Kafka we eventually hit a road bump due to memory issue causing server to fall out of the quorum, which was initially hard to identify with errors in the Tron server. The issue 97 was opened over to discuss on Github in Fluentd Kafka Plugin repository. That got drilled down to the plugin's limitation to counter it bound to the use of the gem ruby-kafka, a fix PR294 was contributed to resolve the issue from happening in future. The fix is now part of the fluent-plugin-kafka as well which will benefit many others. Happy to say that the patch works well in production :).