syslog-ng
zeek-clickhouse
Our great sponsors
| syslog-ng | zeek-clickhouse | |
|---|---|---|
| 8 | 1 | |
| 2,022 | 11 | |
| 1.1% | - | |
| 9.9 | 0.0 | |
| 7 days ago | over 2 years ago | |
| C | Go | |
| GNU General Public License v3.0 or later | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
syslog-ng
-
Fluent-Bit for Splunk
Syslog-ng can feed splunk directly via HEC without having to use heavy forwarders. Earlier you had to hand configure it via the http () destination, v4.2 added this via a separate destination driver. https://github.com/syslog-ng/syslog-ng/releases/tag/syslog-ng-4.2.0
-
23.1.7 is up
ports: syslog-ng 4.1.1[6]
- syslog-ng 4 has been released
- Issue with syslog-ng messages
-
Let's talk logs
Syslog-ng seems a bit weird about open/close source. They have a github but it seems like all the documentation is seemingly all over the place & it's not obvious to find what the limitations of open source version are.
-
I Don't Think Elasticsearch Is a Good Logging System
What we do internally is use [syslog-ng](https://github.com/syslog-ng/syslog-ng) to read the journald socket and push to a remote and into Kafka. I think journald works well as a structured logging tool, but it's certainly deficient in other ways
-
Log management solution
We're using syslog-ng in my apprenticeship, it works just fine, interfacing with a in-prem Prometheus/Elasticsearch
-
OPNsense 21.1.3 released
[12] https://github.com/syslog-ng/syslog-ng/releases/tag/syslog-ng-3.31.1
zeek-clickhouse
-
I Don't Think Elasticsearch Is a Good Logging System
> Uber has not open sourced this work so we are unable to benchmark it and see how it performs
I implemented their design here, specifically for importing zeek logs:
https://github.com/JustinAzoff/zeek-clickhouse
I don't have the elastic compatible query api though, or the smarts that auto materialize popular columns.
It works though, does a good job at soaking up any sort of log type and handling fields being added or removed.
What are some alternatives?
rsyslog - a Rocket-fast SYStem for LOG processing
qryn - qryn is a polyglot, high-performance observability framework for ClickHouse. Ingest, store and analyze logs, metrics and telemetry traces from any agent supporting Loki, Prometheus, OTLP, Tempo, Elastic, InfluxDB and many more formats and query transparently using Grafana or any other compatible client.
fluent-bit - Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows
helm-charts
graylog - Free and open log management
ClickHouse - ClickHouse® is a free analytics DBMS for big data
vector - A high-performance observability data pipeline.
elasticsearch-py - Official Python client for Elasticsearch
systemd - The systemd System and Service Manager