Top 4 Python log-parsing Projects

scrapydweb

6 3,001 3.6 Python

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right:
logparser

2 1,431 7.5 Python

A machine learning toolkit for log parsing [ICSE'19, DSN'16]

Project mention: Log2row: A tool that detects, extracts templates, and structures logs | news.ycombinator.com | 2023-10-06

You use GPT-4 to extract log patterns, does it really need LLM? There are more traditional approach such as https://github.com/logpai/logparser

InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
zero-log-parser

2 29 0.0 Python

Decode Zero log files from the mobile application into text files

Project mention: Zero Motorcycles steps up and makes its service manuals free | news.ycombinator.com | 2023-08-12

This is great news, and somewhat unfortunate something so benign requires celebration.
I used to ride a Zero SR. It was a phenomenal bike but also completely unserviceable in Australia. I ended up reverse engineering the log protocol [1] to get a sense of how it was performing and maintain what I could myself. It was horribly painful, inefficient and completely avoidable spend of time.
Hackability for devices is one thing but when you straddle an energy source that propels you, a fragile meat sack, at speed imo it's essential to have absolute confidence in how the machine behaves.
[1]: https://github.com/zero-motorcycle-community/zero-log-parser

LogParser

1 2 2.7 Python

A Log Parser, that create structured data from log files. (by ZigRazor)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).