Kafka to HTTP POST requests

• faust

  11 1,448 7.9 Python

  Python Stream Processing. A Faust fork (by faust-streaming)

  

I’d like to use Python for this so I came across Faust but I’m not sure if it’s possible to create HTTP requests through Faust or if there are better alternatives.

• parallel-consumer

  7 648 8.5 Java

  Parallel Apache Kafka client wrapper with per message ACK, client side queueing, a simpler consumer/producer API with key concurrency and extendable non-blocking IO processing.

  

I haven’t used Faust, but it should be fine for your use case if you decide not to use the http sink connector. If you are open to Java, the parallel consumer library will have MUCH better performance because the http requests won’t block. It even aims to provide automatic dead letter queue handling sometime in the future, which you mentioned you need.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project