runiq
lnav
| runiq | lnav | |
|---|---|---|
| 2 | 77 | |
| 204 | 6,727 | |
| - | - | |
| 7.4 | 9.6 | |
| 3 months ago | 5 days ago | |
| Rust | C++ | |
| MIT License | BSD 2-clause "Simplified" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
runiq
-
Zet 1.0 is out (compare to uniq and comm)
How does it compare with huniq and runiq?
-
A list of new(ish) command line tools – Julia Evans
A-ha! I knew I had one more.
How many times have you wanted to dedup a (text) file, but definitely didn't have enough memory to perform the task? I found this one day when I had to dedup a set of .ndjson.gz files which totaled a cumulative 312 GBs. Utilizing the bloomfilter option, I was able to dedup the records without any large investment on my part.
Anyways, runiq[1], "[an] efficient way to filter duplicate lines from input, à la uniq".
It provides several ways to filter of which I almost always default to utilizing the bloomfilter implementation (`-f bloom`).
---
[1] https://github.com/whitfin/runiq
[2] https://whitfin.io/filtering-unique-logs-using-rust/
lnav
- Lnav: A log file viewer for the terminal
-
Angle-grinder: Slice and dice logs on the command line
See https://lnav.org for a powerful mini-ETL CLI power tool; it embeds SQLite, supports ~every format, has great UX and easily handles a few million rows at a time.
- FLaNK Stack 26 February 2024
- LNAV – The Logfile Navigator
-
Toolong: Terminal application to view, tail, merge, and search log files
The code base seems like a good reference as a small Python project.
My fav option in this class of apps: https://lnav.org/ It lets you use journalctl with pipes as requested here: https://github.com/Textualize/toolong/issues/4
-
Logdy.dev – web based logs viewer UI for local development environment
For local development, I cannot recommend lnav[1] enough. Discovering this tool was a game changer in my day to day life. Adding comments, filtering in/out, prettify and analyse distribution is hard to live without now.
I don't think a browser tool would fit in my workflow. I need to pipe the output to the tool.
[1] https://lnav.org/
- Textanalysistool.net
- Ask HN: What apps have you created for your own use?
-
Ask HN: How does `lnav` run its playground which you can just SSH into?
It looks like they run an SSH server inside a Docker container defined by this Dockerfile [1]. This uses the ForceCommand directive in the sshd_config file to ensure that a specific command is run when a user connects (rather than the user connecting directly to a shell).
Depending on whether the user connects as the `playground` or `tutorial1` user they interact with a bash script that is either [2] or [3].
[1]: https://github.com/tstack/lnav/blob/master/demo/Dockerfile
[2]: https://github.com/tstack/lnav/blob/master/docs/tutorials/pl...
[3]: https://github.com/tstack/lnav/blob/master/docs/tutorials/tu...
What are some alternatives?
git-crypt - Transparent file encryption in git
lightproxy - 💎 Cross platform Web debugging proxy
nnn - n³ The unorthodox terminal file manager
dive - A tool for exploring each layer in a docker image
lf - Terminal file manager
glow - Render markdown on the CLI, with pizzazz! 💅🏻
ranger - A VIM-inspired filemanager for the console
GoAccess - GoAccess is a real-time web log analyzer and interactive viewer that runs in a terminal in *nix systems or through your browser.
jq - Command-line JSON processor [Moved to: https://github.com/jqlang/jq]
conio-for-linux - Conio.h for linux
huniq - Filter out duplicates on the command line. Replacement for `sort | uniq` optimized for speed (10x faster) when sorting is not needed.