jmx_exporter
opentelemetry-java
Our great sponsors
jmx_exporter | opentelemetry-java | |
---|---|---|
8 | 5 | |
2,896 | 1,839 | |
1.5% | 3.0% | |
8.0 | 9.7 | |
7 days ago | 3 days ago | |
Java | Java | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
jmx_exporter
-
Prometheus JMX Exporter for Java17
not quite sure if this is where I should be asking for help but i'm kind of befuddled about this whole situation. I'm trying to set up https://github.com/prometheus/jmx_exporter for our containerized Java application on our cluster. Specifically the JavaAgent as we are interested in getting the CPU and memory metrics especially. However, getting it initialized I am faced with this:
-
Initial setup
Prometheus doesn't deal with logs at all - only metrics. Even just for metrics, you have several different choices depending on how your Java application is running. You may be able to use the JMX Exporter to expose the metrics that you would then scrape with Prometheus. For the logs, you'll need something like Fluent Bit as an agent to grab ('tail' in Fluent Bit input terms) the logs and send them to Elasticsearch or Grafana Loki.
- Pod log monitoring
- Monitor Java application with prometheus
-
What kind of monitoring tools are people using for their Kafka Deployment?
- https://github.com/prometheus/jmx_exporter - https://github.com/lightbend/kafka-lag-exporter (Export Kafka Topics Lag Metrics) - https://github.com/danielqsj/kafka_exporter (Export Kafka Metrics) - https://github.com/obsidiandynamics/kafdrop (Topic Administration tool - create/edit/delete topics & view messages)
-
Kafka monitoring
Usually I use a javaagent that transforms the JMX metrics into prometheus style metrics, for example: https://github.com/prometheus/jmx_exporter/blob/116a1c4b3fafcfbb9e566b34e130ccc805f331fc/example_configs/kafka-0-8-2.yml
-
Do you use Tomcat ? How to you get optimal performance of it?
Another good one is to add the jmx_exporter agent plugin. This allows easy collection of real-time performance metrics.
-
Kafka Connect: The Magic Behind Mux Data Realtime Exports
In our case, we add sink connectors for AWS Kinesis and Google Cloud PubSub. We also add a Prometheus exporter JAR that scrapes the Kafka Connect JMX metrics and exposes them as Prometheus metrics.
opentelemetry-java
-
Prometheus JMX Exporter for Java17
After doing some research it appears this class references internal packages and therefore "makes it unusable for modern Java apps" (https://github.com/prometheus/client_java/issues/533 , https://github.com/open-telemetry/opentelemetry-java/issues/4192)
-
Python in SRE?
For monitoring: If you want to go the open source route, the open telemetry ecosystem is booming. You could use the open telemetry java agent along with their collector, and then use Elastic APM, which could give you a good starting point. Here is a small example project I found on github that was fun to play around with and explore the capabilities of a setup like this: https://github.com/riferrei/otel-with-apache-pulsar
-
Best performance monitoring tools?
OpenTelemetry and Java Flight Recorder (JFR) cover most bases. Use the OpenTelemetry Java agent if you want auto-instrumentation or just the APIs if you want to do your own instrumentation.
-
Everything you need to know about OpenTelemetry Java auto-instrumentation 👨🏽💻
opentelemetry-java - contains components for manual instrumentation as well as the API and SDK.
-
Everything you need to know about OpenTelemetry Java agent
opentelemetry-java This repo is the main OpenTelemetry Java SDK and provides components for manual instrumentation. Top-level components include OpenTelemetry API, extensions, SDK, bridge layers for OpenTracing and OpenCensus.
What are some alternatives?
Telegraf - The plugin-driven server agent for collecting & reporting metrics.
Zabbix - Real-time monitoring of IT components and services, such as networks, servers, VMs, applications and the cloud.
kafka-lag-exporter - Monitor Kafka Consumer Group Latency with Kafka Lag Exporter
opentelemetry-java-instrumentation - OpenTelemetry auto-instrumentation and instrumentation libraries for Java
kafka_exporter - Kafka exporter for Prometheus
signoz - SigNoz is an open-source observability platform native to OpenTelemetry with logs, traces and metrics in a single application. An open-source alternative to DataDog, NewRelic, etc. 🔥 🖥. 👉 Open source Application Performance Monitoring (APM) & Observability tool
container-jfr - Secure JDK Flight Recorder management for containerized JVMs
otel-with-apache-pulsar - Example of application that produces and consumes events to/from Apache Pulsar. Traces from the transactions are captured using OpenTelemetry and sent to Elastic Observability.
exporterhub.io - A Curated List of Prometheus Exporters
async-profiler - Sampling CPU and HEAP profiler for Java featuring AsyncGetCallTrace + perf_events [Moved to: https://github.com/async-profiler/async-profiler]
kafdrop - Kafka Web UI
Arthas - Alibaba Java Diagnostic Tool Arthas/Alibaba Java诊断利器Arthas