Top 23 Log Open-Source Projects
A high-performance observability data pipeline.Project mention: Vector - A high-performance observability data pipeline. | reddit.com/r/github_trends | 2022-05-15
Fancy stream processing made operationally mundaneProject mention: Programming languages | reddit.com/r/dataengineering | 2022-05-08
You can do some DE work with Golang https://www.benthos.dev/
Deliver Cleaner and Safer Code - Right in Your IDE of Choice!. SonarLint is a free and open source IDE extension that identifies and catches bugs and vulnerabilities as you code, directly in the IDE. Install from your favorite IDE marketplace today.
extract internal monitoring data from application logs for collection in a timeseries databaseProject mention: Server metrics monitoring and reporting for centos? | reddit.com/r/devops | 2022-05-09
For nginx, you'll need to setup a log parser like mtail because it doesn't really have much for metrics to begin with.
Real-time HTTP Intrusion DetectionProject mention: Actively scanning for bugs on random website (Where does it become illegal ?) | reddit.com/r/bugbounty | 2021-11-11
For my personal server I use teler (https://github.com/kitabisa/teler) which is a pretty simple tool which is pretty easy to trigger for an attacker. I wouldn't really take action against anyone as long as they don't intentionally damage something. But I am sure there are many companies who might and there are tools more advanced than teler, I just wanted to give you an example of one monitoring solution.
kubernetes log viewer
Desktop application to efficiently search and analyze super-structured data. Powered by Zed.
WebTools is a collection of tools for Plex Media Server. Like the Unsupported AppStore (UAS)Project mention: Plex not showing newly added movies - can I see a list of filenames indexed? | reddit.com/r/PleX | 2022-03-31
There's also the FindMedia module of WebTools, though there have been some reports of it not working anymore.
Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.
Fast, multi-purpose tool for AWS CloudWatch LogsProject mention: This cloudwatch UI sucks | reddit.com/r/aws | 2021-05-28
Also, for something closer to tail, check out: https://github.com/TylerBrock/saw
An extensible Java library for HTTP request and response logging (by zalando)Project mention: ZALANDO LOGBOOK | reddit.com/r/u_sybrenbolandit | 2021-09-10
For more in depth information take a look at the project’s gihub page here.
An n:m message multiplexer written in Go (by trivago)
A large collection of system log datasets for AI-powered log analyticsProject mention: Mining metrics from unstructured logs | dev.to | 2022-02-24
Here is a summary for a log from the logpai/loghub dataset (kudos to the Logpai team for sharing this dataset):
⎈ Multi pod and container log tailing for Kubernetes -- Friendly fork of https://github.com/wercker/stern (by stern)Project mention: What are your favorite tools you use to manage/work with kubernetes? | reddit.com/r/kubernetes | 2022-03-20
For pod logs, stern is fantastic too.
Really fast log explorer based on glogg projectProject mention: Share your greatest free tools | reddit.com/r/sysadmin | 2022-04-17
Utility logger library for storing logs into database and push them to remote server for debugging
A curated list of amazingly awesome Cybersecurity datasetsProject mention: Smallish dataset for cybersecurity machine learning? | reddit.com/r/datasets | 2021-08-09
The best way to tail AWS CloudWatch Logs from your terminalProject mention: I use cw, which is OSS to tail AWS CloudWatch Logs | dev.to | 2021-07-27
cw is the best way to tail AWS CloudWatch Logs from your terminal. https://github.com/lucagrulla/cw
🌀 Discord Moderation Bot (by jagrosh)Project mention: Discord Moderator Team Issues | reddit.com/r/discordapp | 2022-02-27
If you don't have enough people who meet these criteria to form a cohesive staff team, then you should also consider using an automoderation bot like Vortex. With something like this there will still need to be a level of manual moderation, but a lot of the manual work will be done for you. Even with a large number of staff, you may find that it makes things easier.
WELA (Windows Event Log Analyzer): The Swiss Army knife for Windows Event Logs! ゑ羅（ウェラ）Project mention: Yamato-Security/WELA: WELA (Windows Event Log Analyzer): The Swiss Army knife for Windows Event Logs! ゑ羅（ウェラ） | reddit.com/r/cyber_deception | 2021-12-26
Hayabusa is a sigma-based threat hunting and fast forensics timeline generator for Windows event logs written in Rust.Project mention: Yamato-Security/hayabusa: Hayabusa is a threat hunting and fast forensics timeline generator for Windows event logs. | reddit.com/r/cyber_deception | 2021-12-26
Amazon Web Services CloudWatch Logs Handler for Monolog library
A process manager & log viewer for devProject mention: Ask HN: Freelancer? Seeking freelancer? (April 2022) | news.ycombinator.com | 2022-04-01
SEEKING FREELANCER | REMOTE | Designer
Looking for a UX designer who has exposure to DevOps/Cloud/Programming.
Building numerous new features for https://exo.deref.io and need someone to help wireframe, flesh out the UX, and design high-fidelity screens for implementation.
The ideal candidate for this project is someone who has dabbled in engineering and devops, but is primarily a designer. Also a good fit would be those who have experience designing cloud/devops/eng products in the past.
CSS/HTML implementation skills a big plus, but not strictly required.
Contact [email protected] with a statement of interest, your rates, and a link to your portfolio or other evidence of relevant experience. Thanks!
cLoki: like Grafana Loki, but for ClickhouseProject mention: Show HN: Distributed Tracing Using OpenTelemetry and ClickHouse | news.ycombinator.com | 2021-12-27
cloki can be used to read metrics out of any CH table so it should work fine.
we also just introduced experimental support for ingesting OTLP/ZIPKIN spans and a tempo-compatible API in cloki, looking for testers to validate this feature:
Internally trace spans are stored as tagged JSON logs, meaning they are available from both Loki and Tempo APIs and can be used from pretty much any visualization, too!
Easy log aggregation, indexing and searching (by JackBister)
Logs related posts
Observability Is Not Only for SREs
1 project | news.ycombinator.com | 15 May 2022
Vector - A high-performance observability data pipeline.
1 project | reddit.com/r/github_trends | 15 May 2022
Loki and Promtail, is it possible to PULL logs instead of pushing them to Loki?
1 project | reddit.com/r/grafana | 10 May 2022
I'm a Grafana plugin dev with a free weekend, anyone got any ideas for a plugin they'd like to use?
2 projects | reddit.com/r/grafana | 28 Apr 2022
Openshift-Logging 5.4 is now available | Release notes
1 project | reddit.com/r/openshift | 2 May 2022
Beats – The Lightweight Shippers of the Elastic Stack
2 projects | news.ycombinator.com | 26 Apr 2022
Guys, I’m new here, could you explain me how to send kubernetes logs via rsyslog to a remote monitoring server?
3 projects | reddit.com/r/kubernetes | 25 Apr 2022
What are some of the best open-source Log projects? This list will help you:
|20||CWH (CloudWatch Handler)||351|
Are you hiring? Post a new remote job listing for free.