runiq
huniq
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
runiq
-
Zet 1.0 is out (compare to uniq and comm)
How does it compare with huniq and runiq?
-
A list of new(ish) command line tools – Julia Evans
A-ha! I knew I had one more.
How many times have you wanted to dedup a (text) file, but definitely didn't have enough memory to perform the task? I found this one day when I had to dedup a set of .ndjson.gz files which totaled a cumulative 312 GBs. Utilizing the bloomfilter option, I was able to dedup the records without any large investment on my part.
Anyways, runiq[1], "[an] efficient way to filter duplicate lines from input, à la uniq".
It provides several ways to filter of which I almost always default to utilizing the bloomfilter implementation (`-f bloom`).
---
[1] https://github.com/whitfin/runiq
[2] https://whitfin.io/filtering-unique-logs-using-rust/
huniq
-
Zet 1.0 is out (compare to uniq and comm)
How does it compare with huniq and runiq?
-
I/O is no longer the bottleneck
`sort | uniq` is really slow for this, as it has to sort the entire input first. I use `huniq` which is way faster for this. I'm sure there are many similar options.
https://github.com/koraa/huniq
-
What’s your favorite shell one liner?
For better speed, check out https://github.com/koraa/huniq
What are some alternatives?
git-crypt - Transparent file encryption in git
fzy - :mag: A simple, fast fuzzy finder for the terminal
lnav - Log file navigator
RAMCloud - **No Longer Maintained** Official RAMCloud repo
nnn - n³ The unorthodox terminal file manager
repo
lf - Terminal file manager
napkin-math - Techniques and numbers for estimating system's performance from first-principles
ranger - A VIM-inspired filemanager for the console
share-file-systems - Use a Windows/OSX like GUI in the browser to share files cross OS privately. No cloud, no server, no third party.
jq - Command-line JSON processor [Moved to: https://github.com/jqlang/jq]
hn-search - Hacker News Search