GGet VS internetarchive-downloader

This sounds pretty easy to do with Go, spawn hundreds of threads (which have a ridiculously small ram footprint) and off you go. A google search yielded this: https://github.com/ashwinGokhale/GGet

this tool works well for what you're asking for. https://github.com/john-corcoran/internetarchive-downloader

Another option to get all items in a collection that I used for a script I put together for Internet Archive downloads is the Internet Archive Python Library - official documentation on the relevant function is at https://archive.org/services/docs/api/internetarchive/quickstart.html#searching - and example of using it in code is around line 839 of https://github.com/john-corcoran/internetarchive-downloader/blob/61395ae4fbc826d9578678ed3299ada45d5ec3fd/ia_downloader.py

Using the ‘-r’ flag with my Python script will allow resuming in-progress files, and if you run the script with the same command line arguments each time, you can pick up a collection where you left off - it’s at https://github.com/john-corcoran/internetarchive-downloader

You may want to try this Python script I’ve finished recently for Internet Archive downloads: https://github.com/john-corcoran/internetarchive-downloader - collections should work fine if you pass it with the prefix ‘collection:’, e.g. ‘collection:nasa’ - if you want to give it a try, let me know if any questions!

I’ve made a Python script for this at https://github.com/john-corcoran/internetarchive-downloader which may assist?