-
Logdy.dev
Web based real-time log viewer. Stream ANY content to a web UI with autogenerated filters. Parse any format with TypeScript.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
klp
Kool Logfmt Parser: a CLI viewer for structured log files and streams (logfmt, JSONL and some others)
For those who find this tool interesting, I can recommend to take a look at Logdy.dev (https://logdy.dev) https://github.com/logdyhq/logdy-core
See https://lnav.org for a powerful mini-ETL CLI power tool; it embeds SQLite, supports ~every format, has great UX and easily handles a few million rows at a time.
Angle-grinder is really nice and the successor of sumoshell (by the same author).
I maintain a list of tools like these as part of the docs for my own tool klp (https://github.com/dloss/klp), which I think has a few useful features that are not in angle-grinder, but is orders of magnitude slower, because it's implemented in pure Python instead of Rust.
There’s already a DFIR log tool named chainsaw: https://github.com/WithSecureLabs/chainsaw
---
Bonus recommendation, as it's something I use together with jq and agrind: stern (https://github.com/rancher/stern) — for live tail(1)ing of the O(N) pods of a k8s Deployment, right from the cluster, without any external log multiplexer.
stern ingress-nginx-controller -i some_path_frag -o raw 2>/dev/null | agrind '* | json | where status == 403 | count by client_addr' 2>/dev/null
Related posts
-
Show HN: Search on S3 Using AWS Lambda
-
Show HN: Quickwit – OSS Alternative to Datadog, Elasticsearch
-
Show HN: Quickwit – Cost-Efficient OSS Search Engine for Observability
-
Show HN: Quickwit – Cost-Efficient OSS Search Engine for Observability
-
graylog VS openobserve - a user suggested alternative
2 projects | 7 Sep 2023