Building a realtime performance monitoring system with Kafka and Go

1. kafka-test

   1 1 10 0.0 Go

   Kafka setup to pull system stats from OS and display in UI

   Realtime system monitoring

2. CodeRabbit

   coderabbit.ai featured

   CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

   

3. prometheus

   2 449 57,645 10.0 Go

   The Prometheus monitoring system and time series database.

   

   We could have used a much more focussed tool like Prometheus or Cadvisor to gather system stats, but that is not the main objective of this article.

4. cadvisor

   3 47 17,664 7.9 Go

   Analyzes resource usage and performance characteristics of running containers.

   

   We could have used a much more focussed tool like Prometheus or Cadvisor to gather system stats, but that is not the main objective of this article.

5. ApacheKafka

   4 128 35 0.0

   A curated re-sources list for awesome Apache Kafka

   

   Recently, I had a chance to try out Apache's Kafka for a monitoring service and I was pleasantly surprised how you could set up a full fledged event streaming system in a few lines of code. I quickly realised we could be building powerful systems with Kafka at the centre of things. Notification systems, distributed database synchronisations, monitoring systems are some of the applications that come to mind when thinking of Kafka's use-cases. In my quest to understand Kafka a bit more deeply, I tried setting up a system monitoring application which looks for system stats like CPU and RAM usage and visualises them in a dashboard.

6. Gin

   5 165 80,745 7.6 Go

   Gin is a HTTP web framework written in Go (Golang). It features a Martini-like API with much better performance -- up to 40 times faster. If you need smashing performance, get yourself some Gin.

   

   Our main function in this service is very simple. There is a single POST endpoint to receive stats. I'm using Gin framework for routing here.

7. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

Suggest a related project