Large scale flow collection

This page summarizes the projects mentioned and recommended in the original post on /r/networking

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • goflow

    The high-scalability sFlow/NetFlow/IPFIX collector used internally at Cloudflare.

  • Grafana

    The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.

    It uses goflow as your collecting agent, Kafka to buffer and store the data, and ClickHouse to provide the analysis engine, and Grafana for visualization.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • mtail

    extract internal monitoring data from application logs for collection in a timeseries database

    I have goflow running on a tiny network, just dumping the data into log files for a similar use case. I parse the output with mtail to produce some simple graphs.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts