mpd_what VS dedupe

mpd_what is a python script I developed to show the album art, artist, album, and song for music I am listening to with mpd, including (some) internet radio. I made this because I didn't want to have to download and install all the different radio apps for my phone just to maybe see the coverart and info of what they're playing. This script works to enhance one of my other utilities, which is:

Shameless plug: I wrote a script to grab album art, title, track, and album for music being played on mpd, even internet radio. Check it out at https://github.com/charmparticle/mpd_what

I wrote https://github.com/Gumnos/dedupe which sounds like it might be useful to you. It's faster than several of the alternatives I've found (many run the checksum across the whole of every file, this uses the file-size as a first-line discriminator, and only if the files are the same size does it go to the trouble of checking the checksum of the files). I designed it for creating hard-links in my media collection, but in the --dry-run mode, it should emit the file-names allowing you to pass it to xargs to remove them if it looks copacetic.

You can use my dedupe.py script with the dry-run flag (-n) to find all the duplicates on your drive. If you run it without the dry-run flag, it will attempt to make hard-links so that each file exists only once on the drive with multiple hard-links to the underlying file. It should be pretty fast, only needing to checksum file-content in the event that files have the same size (several other such deduplication methods work by checksumming every file on the drive which can be slow).

a file-deduplication utility that hard-links duplicate files to save space (our family photo gallery gets pics put in multiple albums for various audiences, so I can cut down on a lot of duplication with this)