jdupes
icloud_photos_downloader
Our great sponsors
jdupes | icloud_photos_downloader | |
---|---|---|
44 | 97 | |
1,681 | 5,885 | |
- | 3.9% | |
0.0 | 8.3 | |
7 months ago | 7 days ago | |
C | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
jdupes
-
File Servers... how are you handling duplicates
I recommend the use of jdupes, a fork of the well-known fdupes, to find duplicate files.
-
fdupes: Identify or Delete Duplicate Files
200 lines of Nim [1] seems to run about 9X faster than the 8000 lines of C in fdupes on a little test dir I have. If you need C, I think jdupes [2] is faster as @TacticalCoder points out a couple of times here. In my testing, `dups` is usually faster than `jdupes`, though.
[1] https://github.com/c-blake/bu/blob/main/dups.nim
[2] https://github.com/jbruchon/jdupes
-
I'm amazed how I find anything & why I have so many dupes!
There's always the well-respected tool, Czkawka. Or, of the CLI is your thing, jdupes is a good option.
- Anyone know of any good file deduplication tools?
-
Johnny Decimal
My research into this many years ago turned out that jdupes was the right / best solution I could find for my usecase.
https://github.com/jbruchon/jdupes
Though that works fine from a script perspective I'd like some more interactive way of sorting directories etc. Identifying is just the first step, jdupes helps with linking the files (both soft and hard links comes with caveats though!) but that is mostly to save space, not to help in reorganisation.
- Jdupes: A powerful duplicate file finder
-
Does jdupes do a 'dry run' if you just specify directory(s) and no other options
I can work it out by looking at https://github.com/jbruchon/jdupes.
-
replace duplicates with hard links - I think jdupes is the answer, or maybe fclones (I have questions)
I have looked at a few alternatives and think jdupes is the one for me. Then I found out it was not multi-threaded so will give it a go but the developer of jdupes recomended fclones (https://github.com/jbruchon/jdupes/issues/186) if you were dealing with large file systems and wanted multi-threading. But as I am using a HD it may not be necessary.
-
De-Duping a file server
jdupes is a fork of the old standby fdupes, but it has a Win32 release as well as supporting POSIX.
-
Any good duplicate file finder for windows?
jdupes is a tuned fork of the well-known fdupes, and has Win32 releases.
icloud_photos_downloader
-
Building an e-ink picture frame that displays an iCloud photo album
> They don't offer an appropriate API to get photos out.
There's this: https://developer.apple.com/documentation/photokit "The framework provides access to photos on the person’s device and in iCloud."
If you want to use undocumented APIs on non-Apple devices directly, there are projects like https://github.com/steilerDev/icloud-photos-sync and https://github.com/icloud-photos-downloader/icloud_photos_do... that appear to be able to do this.
- I have an extra pi4 I’m mailing to my parents to create a cloud drive for their home since they’re privacy sensitive. What’s the easiest way to make the pi read/writeable from their iPhones at home?
- icloud: error while loading shared libraries: libz.so.1: failed to map segment from shared object
-
icloud_photos_downloader VS icloud-photos-sync - a user suggested alternative
2 projects | 21 Oct 2023
-
LANDrop – Drop any files to any devices on your LAN
If you have iCloud, you can use icloud.com to get all your photos in a zip.
Or you can use scripts like this one : https://github.com/icloud-photos-downloader/icloud_photos_do...
-
Self-hosted photo and video backup solution directly from your mobile phone
I use https://github.com/icloud-photos-downloader/icloud_photos_do... running on my NAS to regularly download photos from my wife's iCloud account. The photos are stored in full resolution on iCloud with the EXIF data, unlike Google Photos, so that's nice. The only annoyance is that you need to reauthorize the tool every three months. But it sends you a reminder when the time is coming up.
-
Opinions ? I just went from Drobo 5D3 to Synology NAS
I keep my photos in iCloud and sync them up to a Synology NAS (using icloudpd) which is backed up to Backblaze B2.
-
Selfhosted backup solution for iCloud Backup
Direct project link https://github.com/icloud-photos-downloader/icloud_photos_downloader
-
Help with massive Photos library please
I was able to download 2 x 2TB (4TB) icloud photos accounts using this in 2 days if you are comfortable with the command line https://github.com/icloud-photos-downloader/icloud_photos_downloader There’s no other solution the mac app was very slow and was gonna takes weeks for me but this app downloaded everything in 2 days
-
iCloud Media Download and Organization
A set of PowerShell scripts to download and organize iCloud media. The scripts use the awesome iCloud downloader from https://github.com/icloud-photos-downloader/icloud_photos_downloader to do the actual download. And the organization happens in a specific way…
What are some alternatives?
fdupes - FDUPES is a program for identifying or deleting duplicate files residing within specified directories.
rclone - "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files
dupeguru - Find duplicate files
docker-icloudpd - An Alpine Linux 3.19.0 container for the iCloud Photos Downloader command line utility
rmlint - Extremely fast tool to remove duplicates and other lint from your filesystem
syncthing-android - Wrapper of syncthing for Android.
rdfind - find duplicate files utility
librephotos - A self-hosted open source photo management service. This is the repository of the backend.
czkawka - Multi functional app to find duplicates, empty folders, similar images etc.
Nextcloud - ☁️ Nextcloud server, a safe home for all your data
duperemove - Tools for deduping file systems
arq_restore - command-line utility for restoring from Arq backups