filedriller VS library

The 5.3GB is an old value in the documentation from the web site, I have to correct that, thanks. I got it down to 3.5GB. However, you are right, this is a huge number of SHA1s. I once had another tool, filedriller (https://github.com/steffenfritz/filedriller), that I presented at iPres and used a Redis db for that with less than 1GB. Redis handles that better than Bolt. On the other hand, NIST changed the NSRL format and range (in the sense of years and systems) of the RDS sets. So I think the overhead is not too big. We have over 62.500.000 hashes in it. I think that's ok :)

Sure, I write small python CLI utils that help me solve media organization, media consumption, and sometimes data analysis. I use this every day on Linux and Android but I haven't tested it on other platforms. There are a lot of different subcommands and, although the CLI package will always be opinionated to some extent, there is a lot of niche functionality which might not need to exist. So I'm open to things being refactored or new subcommands being added. [1]

I have a lot of ideas for new ones, for example, I want a CLI that can take an artist name like "Theodor Kittelsen" and fetch highest quality public domain images--but I realize any implementation that does this well will be somewhat fragile so I haven't really attempted that yet. Other ideas that I have are often solved by piping output from one of my existing commands to another.

1. https://github.com/chapmanjacobd/library

I used sqlite-utils to create a tool that can merge SQLITE files and split them:

https://github.com/chapmanjacobd/library?tab=readme-ov-file#...

I've created a few similar tools for link scraping: https://github.com/chapmanjacobd/library#usage

- library links-extract: extract inner links from pages (stdin, local files, or remote sites)

okay https://github.com/chapmanjacobd/library

I'm adding more unit tests: https://github.com/chapmanjacobd/library/commit/bd2e138897fdf41b8d8eade89bcdb34fee2b6abd

I would also[0] be interested in an argparse equivalent of this for my tool Library[1]

[0] https://github.com/Textualize/textual/discussions/228

[1] https://github.com/chapmanjacobd/library

I have a little over 2 million songs as well and I wrote my own media management system to deal with it all. I save everything as Opus so the size is relatively small but still high-quality.

Losing the data from the hard drive AND the internet is less likely than just one of those events happening. Recently I accidentally deleted 12 TB of media and I was able to redownload 80% of it using a script that I wrote. 20% of it I had to manually redownload but everything was still there.