Ingesting XML data into Kafka - Option 2: Kafka Connect plus Single Message Transform

This page summarizes the projects mentioned and recommended in the original post on dev.to
kafka-connect Kafka ksql XML ElasticSearch

InfluxDB
Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • demo-scene

    👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/

    • You can find the code to run this for yourself using Docker Compose on GitHub.

  • kafka-connect-transform-xml

    Transformation for converting XML data to Structured data.

    • I’ve had a a few challenges getting the SMT to work, in particular with certain schemas. Some things to watch out for:

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts