Rust Deduplication

Open-source Rust projects categorized as Deduplication

Top 5 Rust Deduplication Projects

  • rustic

    rustic - fast, encrypted, and deduplicated backups powered by Rust

  • Project mention: Duplicity | news.ycombinator.com | 2024-01-24

    I'm a huge fan of restic as well. My only complaint is performance and memory usage. I'm looking forward to being able to use Rustic: https://rustic.cli.rs/

  • rdedup

    Data deduplication engine, supporting optional compression and public key encryption.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • deduplicator

    Filter, Sort & Delete Duplicate Files Recursively

  • cargo-limit

    Productivity improvements for Rust ecosystem: warnings are skipped until errors are fixed, LSP-independent Neovim integration, etc.

  • photodedupe

    A utility for locating near duplicate photos irrespective of image resolution, compression settings or file format.

  • Project mention: Tips for cleaning duplicate files out of directories | /r/linux | 2023-06-05

    That focuses on exact duplicates through hashing. I found https://github.com/InexplicableMagic/photodedupe to be helpful for finding near duplicates in images through LSH.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust Deduplication related posts

  • Rustic – fast, encrypted, and deduplicated backups

    1 project | news.ycombinator.com | 29 Dec 2023
  • Anouncing rustic_core - a library for fast, encrypted, deduplicated backups

    3 projects | /r/rust | 22 Sep 2023
  • rustic - fast, encrypted, and deduplicated backups made with Rust

    1 project | /r/rust | 8 Sep 2023
  • Diff tool for medias

    2 projects | /r/software | 27 May 2023
  • App to find duplicates across multiple external drives (Mac/Unix)

    2 projects | /r/DataHoarder | 16 May 2023
  • Good windows software to find duplicate files fast?

    2 projects | /r/DataHoarder | 26 Apr 2023
  • Announcing rustic - fast, encrypted, deduplicated backups powered by Rust

    9 projects | /r/rust | 24 Apr 2023
  • A note from our sponsor - SaaSHub
    www.saashub.com | 4 May 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Deduplication projects in Rust? This list will help you:

Project Stars
1 rustic 1,541
2 rdedup 818
3 deduplicator 254
4 cargo-limit 240
5 photodedupe 16

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com