Toolong: Terminal application to view, tail, merge, and search log files

• toolong

  3 2,692 9.2 Python

  A terminal application to view, tail, merge, and search log files (plus JSONL).

  

The code base seems like a good reference as a small Python project.

My fav option in this class of apps: https://lnav.org/ It lets you use journalctl with pipes as requested here: https://github.com/Textualize/toolong/issues/4

• lnav

  75 6,686 9.5 C++

  Log file navigator

The code base seems like a good reference as a small Python project.

My fav option in this class of apps: https://lnav.org/ It lets you use journalctl with pipes as requested here: https://github.com/Textualize/toolong/issues/4

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• klogg

  11 1,992 8.3 C++

  Really fast log explorer based on glogg project

I'd love to see a tool that lets you modify large files efficiently.

I had to replace line 4 of a 200 GB SQL dump, it took a substantial amount of compute time to perform a find / replace with sed and it also required having over double the disk space since sed creates a temp file before it writes out the new file.

Using a hex editor could have worked but it seemed too risky because data integrity was really important.

There's also some other scenarios where maybe you have a massive file and the tool that's using it (such as a SQL import) throws an error on line 1,025,421. Trying to find what the contents of that line is on the command line could be time consuming if you need to read in the whole file. For read operations I know there's a few graphical tools like https://github.com/variar/klogg that efficiently let you scan, search and jump to points in a file quickly but I haven't found a good one on the command line.

• LogDiff

  1 21 10.0 C++

  Split and compare ProcMon trace logs using a visual diff tool

https://github.com/harjoc/LogDiff (shameless plug). Unmaintained, parses only ProcMon, but does the steps you describe, and uses Kdiff3 for diffs. With threaded apps it can be hard to identify automatically which thread is which.

• diff-logs

  1 8 6.9 Python

  Command-line utility for diff'ing all kinds of logs.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project