SaaSHub helps you find the best software and product alternatives Learn more →
Top 20 Log Management Open-Source Projects
-
openobserve
🚀 10x easier, 🚀 140x lower storage cost, 🚀 high performance, 🚀 petabyte scale - Elasticsearch/Splunk/Datadog alternative for 🚀 (logs, metrics, traces, RUM, Error tracking, Session replay).
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
quickwit
Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.
-
hyperdx
Resolve production issues, fast. An open source observability platform unifying session replays, logs, metrics, traces and errors powered by Clickhouse and OpenTelemetry.
-
-
syslog-ng
syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.
-
matano
Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
HyperLog Android
Utility logger library for storing logs into database and push them to remote server for debugging
-
-
Logdy.dev
Web based real-time log viewer. Stream ANY content to a web UI with autogenerated filters. Parse any format with TypeScript.
-
-
-
-
Echofish
Central syslog manager with whitelisting and ability to generate events from syslog entries
-
-
ze-fluentd-plugin
Zebrium's fluentd output plugin sends the logs you collect with fluentd to Zebrium for automated anomaly detection.
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: Show HN: OneUptime – open-source Datadog Alternative | news.ycombinator.com | 2024-04-02Lot of interesting OSS observability products coming out in recent years. One of the more impressive(and curious for many reasons) IMHO is OpenObserve: https://github.com/openobserve/openobserve .
As opposed to just a stack, they are implementing just about the whole backend shebang from scratch.
Project mention: graylog VS openobserve - a user suggested alternative | libhunt.com/r/graylog2-server | 2023-09-07
Project mention: Show HN: HyperDX Local – Open-source Datadog alternative for local debugging/dev | news.ycombinator.com | 2024-04-02Hi HN, Mike and Warren here! We’ve been building an open source local-dev-friendly mode for HyperDX (hyperdx.io). It's a single Docker container that lets you view logs, metrics, and traces for local development in a similar way you can use them for production (live tail, filter/correlate logs & spans, build charts, flamegraph, etc.) Basically, imagine you can run Datadog in a single container for local development. We does this by spinning up an OpenTelemetry collector, Clickhouse DB and HyperDX UI all in a single container - it only takes a few seconds to start and lets you start live tailing your local logs and traces immediately (and graph metrics of course).
README (w/ demo gif): https://github.com/hyperdxio/hyperdx/blob/main/LOCAL.md
We started building local mode as it became one of our most loved [1] community issue after sharing HyperDX. It made sense - as we constantly use HyperDX to debug our own issues locally, and have found it to be a huge productivity boost for things like…
1. Tailing multiple container logs (and grepping/isolating them) without a ton of different terminal splits open at the same time.
2. Be able to sensibly view structured logs and correlated traces to debug local issues (because you’re using structured logging and tracing right?) instead of adding ad-hoc console statements that print out exactly what I could’ve gotten from tracing.
3. Testing telemetry are actually emitting/correlating as expected, before shipping it all the way out to prod and realizing I accidentally created a very expensive high-cardinality metric or a span that has the wrong properties.
We spent some time packaging & tuning our existing OSS stack to run in a single container with less memory/space requirements by staring at `dive` to slim down the image and applied incantations from documentation until memory usage improved. Additionally we removed a few non-local-friendly things like authentication requirements and extraneous services.
It still has all the goodness you’d want - so you can full text search your logs/traces, live tail all your events, view spans correlated with logs (and vice versa), create dashboards based on logs, metrics, traces, and is fully OpenTelemetry compatible - just point your Otel SDK/collector to http://localhost:4318 (or 4317 for the grpc folks) and you’re already good to go.
I’m excited to share what we’ve been working on and would love to hear your feedback and opinions!
Spin up the container yourself to try it out:
docker run -p 8000:8000 -p 4318:4318 -p 4317:4317 -p 8080:8080 -p 8002:8002 hyperdx/hyperdx-local
Main Open Source Repo: https://github.com/hyperdxio/hyperdx
Hosted Demo (in case you want to play around in a cloud sandbox instead): https://api.hyperdx.io/login/demo
HyperDX Landing Page: https://hyperdx.io
[1]: https://github.com/hyperdxio/hyperdx/issues/7
Syslog-ng can feed splunk directly via HEC without having to use heavy forwarders. Earlier you had to hand configure it via the http () destination, v4.2 added this via a separate destination driver. https://github.com/syslog-ng/syslog-ng/releases/tag/syslog-ng-4.2.0
sorry thats https://matano.dev
Project mention: Siglens: A columnar OLAP db that can execute queries 50x faster than ClickHouse | news.ycombinator.com | 2024-02-20I found their claims exaggerated: https://github.com/siglens/siglens/issues/created_by/alexey-...
Project mention: Angle-grinder: Slice and dice logs on the command line | news.ycombinator.com | 2024-04-29For those who find this tool interesting, I can recommend to take a look at Logdy.dev (https://logdy.dev) https://github.com/logdyhq/logdy-core
Project mention: UTMStack: Open-Source SIEM, XDR Powered by Real-Time Correlation | news.ycombinator.com | 2024-02-14
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Log Management related posts
-
Show HN: HyperDX Local – Open-source Datadog alternative for local debugging/dev
-
Show HN: Ellipsis – Automatic pull request reviews
-
Show HN: Search on S3 Using AWS Lambda
-
Show HN: Quickwit – OSS Alternative to Datadog, Elasticsearch
-
Show HN: Quickwit – Cost-Efficient OSS Search Engine for Observability
-
Show HN: Quickwit – Cost-Efficient OSS Search Engine for Observability
-
HyperDX – open-source dev-friendly Datadog alternative
-
A note from our sponsor - SaaSHub
www.saashub.com | 4 May 2024
Index
What are some of the best open-source Log Management projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | openobserve | 9,648 |
| 2 | graylog | 7,118 |
| 3 | quickwit | 6,152 |
| 4 | hyperdx | 6,123 |
| 5 | Flume | 2,505 |
| 6 | syslog-ng | 2,035 |
| 7 | matano | 1,355 |
| 8 | SigLens | 998 |
| 9 | HyperLog Android | 689 |
| 10 | Hindsight | 668 |
| 11 | Logdy.dev | 414 |
| 12 | graylog-docker | 352 |
| 13 | UTMStack | 182 |
| 14 | Octopussy | 151 |
| 15 | Echofish | 82 |
| 16 | logdna-agent-v2 | 61 |
| 17 | Security-Log-Generator | 23 |
| 18 | ze-fluentd-plugin | 3 |
| 19 | LogParser | 2 |
| 20 | Sending your docker logs | 1 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com