Is it a good idea to write logs into Kafka from Go services?

This page summarizes the projects mentioned and recommended in the original post on /r/golang

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • Riemann

    A network event stream processing system, in Clojure.

  • This is fine- we do something similar using riemann.

  • Fluentd

    Fluentd: Unified Logging Layer (project under CNCF)

  • This depends a bit on how/where you run your code, but I would not let your application be concerned with where the logs are pushed. I'd prefer just writing to stdout/stderr and let the host worry about where the logs go. This is where something like fluentd can help. It supports pushing to Kafka.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts