runiq

An efficient way to filter duplicate lines from input, Ć  la uniq. (by whitfin)

Runiq Alternatives

Similar projects and alternatives to runiq

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better runiq alternative or higher similarity.

runiq reviews and mentions

Posts with mentions or reviews of runiq. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-04-18.
  • Zet 1.0 is out (compare to uniq and comm)
    4 projects | /r/rust | 18 Apr 2023
    How does it compare with huniq and runiq?
  • A list of new(ish) command line tools ā€“ Julia Evans
    56 projects | news.ycombinator.com | 12 Apr 2022
    A-ha! I knew I had one more.

    How many times have you wanted to dedup a (text) file, but definitely didn't have enough memory to perform the task? I found this one day when I had to dedup a set of .ndjson.gz files which totaled a cumulative 312 GBs. Utilizing the bloomfilter option, I was able to dedup the records without any large investment on my part.

    Anyways, runiq[1], "[an] efficient way to filter duplicate lines from input, Ć  la uniq".

    It provides several ways to filter of which I almost always default to utilizing the bloomfilter implementation (`-f bloom`).

    ---

    [1] https://github.com/whitfin/runiq

    [2] https://whitfin.io/filtering-unique-logs-using-rust/

Stats

Basic runiq repo stats
2
204
7.4
2 months ago

whitfin/runiq is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of runiq is Rust.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com