mtail VS snmpcollector

You can do that with something like mtail. Basically write expressions that match your logs and produce metrics.

mtail is a standard tool for this.

I use goflow2 to do something like this. I don't specifically use syslog itself for this, but mtail to generate the metrics.

I can recommend mtail. Here is a good example nginx script.

If not, https://github.com/google/mtail might be a good option.

Count the lines with mtail. You can regexp match the values out into labels.

If you want to extract whitebox metrics from logs, maybe all you need is mtail.

You can use mtail (https://github.com/google/mtail) for this. You'll need to figure out how to plug it into your setup, but mtail will do the metrics from logs thing.

Convert your logs to metrics with mtail.

For nginx, you'll need to setup a log parser like mtail because it doesn't really have much for metrics to begin with.

SnmpCollector is a full-featured, open-source generic SNMP data collector with a web administration interface. Simplifies the configuration needed to get data from devices with snmp support to an influxdb backend. hombre_sabio adds, "It aims to simplify the alignment for collecting data from various sources [to] send the data to the InfluxDB backend."

SNMP is great when implemented by others and you just ask your poller to fetch what you need every 30s to 5 minutes. You can go faster with SNMP but, you're stretching it. The fastest Poller i worked with is this one: https://github.com/toni-moreno/snmpcollector

At least a demo can be done with snmpcollector + influxdb (+ Grafana?). I think it allows faster polling, however if I recall, the polling interval is always configured in the measurement template itself.

One solution I tested. However I have no clue how it compares performance-wise.