loghub VS loglizer

https://github.com/logpai/loglizer has an MIT license. Seems like they've done some of the heavy lifting already. If you're just looking for logs, check out https://github.com/logpai/loghub.

Here is an example apache log fie: If you want to try and prove me wrong write a script to find and return line numbers which contain the string "Directory index forbidden" or some other substring which is better then O(N).

Any text? How about Loghub? Maybe you could visualize links in error messages for failure analysis, for example does a seemingly harmless warning seem to be linked to a much worse problem that occurs later?

Here is a summary for a log from the logpai/loghub dataset (kudos to the Logpai team for sharing this dataset):

https://github.com/logpai/loglizer has an MIT license. Seems like they've done some of the heavy lifting already. If you're just looking for logs, check out https://github.com/logpai/loghub.

If you want to really get paranoid, then you can write a monitoring app that uses machine learning to do the log analysis and detect anomalies in your system. There are some open source tools available, like this for example. Also you can train the network for your specific use case and then just have the service running the inference on your logs and a pre-trainer model that is running on system logs. Then you really get in paranoid mode.