jdupes
phockup
Our great sponsors
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
jdupes
-
File Servers... how are you handling duplicates
I recommend the use of jdupes, a fork of the well-known fdupes, to find duplicate files.
-
fdupes: Identify or Delete Duplicate Files
200 lines of Nim [1] seems to run about 9X faster than the 8000 lines of C in fdupes on a little test dir I have. If you need C, I think jdupes [2] is faster as @TacticalCoder points out a couple of times here. In my testing, `dups` is usually faster than `jdupes`, though.
[1] https://github.com/c-blake/bu/blob/main/dups.nim
[2] https://github.com/jbruchon/jdupes
-
I'm amazed how I find anything & why I have so many dupes!
There's always the well-respected tool, Czkawka. Or, of the CLI is your thing, jdupes is a good option.
- Anyone know of any good file deduplication tools?
-
Johnny Decimal
My research into this many years ago turned out that jdupes was the right / best solution I could find for my usecase.
https://github.com/jbruchon/jdupes
Though that works fine from a script perspective I'd like some more interactive way of sorting directories etc. Identifying is just the first step, jdupes helps with linking the files (both soft and hard links comes with caveats though!) but that is mostly to save space, not to help in reorganisation.
- Jdupes: A powerful duplicate file finder
-
Does jdupes do a 'dry run' if you just specify directory(s) and no other options
I can work it out by looking at https://github.com/jbruchon/jdupes.
-
replace duplicates with hard links - I think jdupes is the answer, or maybe fclones (I have questions)
I have looked at a few alternatives and think jdupes is the one for me. Then I found out it was not multi-threaded so will give it a go but the developer of jdupes recomended fclones (https://github.com/jbruchon/jdupes/issues/186) if you were dealing with large file systems and wanted multi-threading. But as I am using a HD it may not be necessary.
-
De-Duping a file server
jdupes is a fork of the old standby fdupes, but it has a Win32 release as well as supporting POSIX.
-
Any good duplicate file finder for windows?
jdupes is a tuned fork of the well-known fdupes, and has Win32 releases.
phockup
-
Photos - import a downloaded icloud library?
If you want to manually do the year month day folder structure, as well as even naming files by date, I use phockup. It’s very handy and supports a lot of formatting options, so you can format it just like synology does so it’s all consistent. It’s also fun to say. Will you shut the phockup?!
- Do you know any Free AI to use locally to sort photos?
-
Automaticly move pictures to a yearly and monthly folder
phockup works for me, and is also a fun word to say over and over
- Name a program that doesn't get enough love!
-
Best way to identify and delete duplicate photos/videos?
I'm a fan of czkawka as a client. And phockup as a docker automation image deduper.
-
Using CLI Flags
I found a cool photo organizing tool called Phockup and I can get the basic command completed to get my photos moved to the folders:
-
Software that sorts through photos and videos per date and arranges them per folder
Phockup
- achoz: a selfhost search engine for your personal data.
-
Just joined the F-droid family. Looking for alternatives to Google photos
Agreed Nextcloud photos is rubbish. I used a tool on my photo directory in NextCloud to sort my photos by date and ran a scan afterwords to have NextCloud recognize the change. Not ideal but it worked. Looking for an app to point at that directory, but I don't think I am sold on PhotoPrismI am hoping Photonix adds video support because it looks great.
- Photo upload and sync workflow help.
What are some alternatives?
fdupes - FDUPES is a program for identifying or deleting duplicate files residing within specified directories.
GooglePhotosTakeoutHelper - Script that organizes the Google Takeout archive into one big chronological folder
dupeguru - Find duplicate files
Photonix - A modern, web-based photo management server. Run it on your home server and it will let you find the right photo from your collection on any device. Smart filtering is made possible by object recognition, face recognition, location awareness, color analysis and other ML algorithms.
rmlint - Extremely fast tool to remove duplicates and other lint from your filesystem
photos - 📸 Your memories under your control
rdfind - find duplicate files utility
google-photos-exif - A tool to populate missing `DateTimeOriginal` EXIF metadata in Google Photos takeout, using Google's JSON metadata.
czkawka - Multi functional app to find duplicates, empty folders, similar images etc.
icloud_photos_downloader - A command-line tool to download photos from iCloud
duperemove - Tools for deduping file systems
achoz - Search through all your personal data efficiently like web search.