Recommendation Needed. I just received several terabytes of unstructured data. It appears that the user would reate a backup of his files "Backup 1", "Backup 2", etc, and then drag entire copies of his files over. There are thousands of duplicate files. Can someone recommend a good file dedupe app?

This page summarizes the projects mentioned and recommended in the original post on /r/sysadmin
Deduplication Python C duplicate-files Fast

WorkOS
Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • dupeguru

    Find duplicate files

    I've used DupeGuru in the past.

  • jdupes

    Discontinued A powerful duplicate file finder and an enhanced fork of 'fdupes'.

    jdupes is a powerful and fast command-line tool to find and remove duplicate files. Linux and Windows.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts