Fclones – an efficient duplicate file finder and remover

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • fclones

    Efficient Duplicate File Finder

  • dupe-krill

    A fast file deduplicator

  • Coincidentally I was looking through the list of apps that do this the other day, I think I looked at all the other ones they list as competitors.

    My particular use case involved images that might be very near duplicates (screenshots of the same web page), which some of the tools cover, though it feels like a slightly seperate task from the exact bit duplicates, so not all do it.

    One interesting one I found that wasn't listed in the Readme was:

    https://github.com/kornelski/dupe-krill

    Which had some notes about their use of BTreehashes to progressively compare files. Not sure how much difference it makes in practice but sounded elegant.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts