What's a really niche tool you use that you can't live without?

This page summarizes the projects mentioned and recommended in the original post on /r/DataHoarder

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • youtube-dl

    Command-line program to download videos from YouTube.com and other video sites

  • I assume that by now most of us have heard of youtube-dl/yt-dlp, and gallery-dl. And sure those are really really good if you want to download from sites popular enough to warrant extractors. But what if what you want to archive can't be archived by these tools?

  • yt-dlp

    A feature-rich command-line audio/video downloader

  • I assume that by now most of us have heard of youtube-dl/yt-dlp, and gallery-dl. And sure those are really really good if you want to download from sites popular enough to warrant extractors. But what if what you want to archive can't be archived by these tools?

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • megatools

    Discontinued Open-source command line tools for accessing Mega.co.nz cloud storage.

  • I want to see tools most of us have never heard or even thought of. Extractors for obscure websites or websites we don't think of in terms of extractors like megatools or Mediafire Bulk Downloader. "Glue" tools like rclone's serve command (as well as the rest of rclone) and lftp that makes stuff work together easier. Phone apps like FE File Explorer Pro (sadly the free version seems to be gone) that makes accessing a home FTP server so much easier (once you've set up OpenVPN of course)

    I assume that by now most of us have heard of youtube-dl/yt-dlp, and gallery-dl. And sure those are really really good if you want to download from sites popular enough to warrant extractors. But what if what you want to archive can't be archived by these tools?

  • mediafire_bulk_downloader

    Script for bulk downloading entire mediafire folders for free using python.

  • I want to see tools most of us have never heard or even thought of. Extractors for obscure websites or websites we don't think of in terms of extractors like megatools or Mediafire Bulk Downloader. "Glue" tools like rclone's serve command (as well as the rest of rclone) and lftp that makes stuff work together easier. Phone apps like FE File Explorer Pro (sadly the free version seems to be gone) that makes accessing a home FTP server so much easier (once you've set up OpenVPN of course)

  • plugins

    Plugins and shell scripts for integrating 3rd party tools with FileBot (by filebot)

  • Filebot - automatically rename and categorise media for Plex with metadata lookup. It’s amazing

  • Cathy

    Cross-platform python implementation of Robert Vasicek's Win-only popular Cathy disk catalog tool

  • Cathy the catalog tool. Great tool for locating your files across multiple drives/external media etc. Original is Windows only, but there is a Python port: https://github.com/binsento42/Cathy

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • mkvtoolnix-batch-tool

    Batch video and subtitle processing program with the ability to add, remove, or extract subtitles from all video files in a directory and its sub-directories.

  • The MKVToolNix Batch Tool has been helpful for speeding up the process of adding subtitles to videos in bulk.

  • sickbeard_mp4_automator

    Automatically convert video files to a standardized format with metadata tagging to create a beautiful and uniform media library

  • Sickbeard mp4 Automator for media conversation and metadata matching. Combined with mediaelch for bulk renaming and poster downloads, they’re essential for plex hosting. Also use subler for quick metadata/language code fixes.

  • fzf

    :cherry_blossom: A command-line fuzzy finder

  • https://github.com/junegunn/fzf with custom settings and tweaks. Absolutely indispensable for the search in hoarded data.

  • httm

    Interactive, file-level Time Machine-like tool for ZFS/btrfs/nilfs2 (and even actual Time Machine backups!)

  • httm - Interactive, file-level Time Machine-like tool for ZFS/btrfs/nilfs2

  • fd

    A simple, fast and user-friendly alternative to 'find'

  • ohmyzsh

    🙃 A delightful community-driven (with 2,300+ contributors) framework for managing your zsh configuration. Includes 300+ optional plugins (rails, git, macOS, hub, docker, homebrew, node, php, python, etc), 140+ themes to spice up your morning, and an auto-update tool so that makes it easy to keep up with the latest updates from the community.

  • oh-my-zsh

  • alacritty

    A cross-platform, OpenGL terminal emulator.

  • Alacritty was great but Kitty is just awesome.

  • kitty

    Cross-platform, fast, feature-rich, GPU based terminal

  • Alacritty was great but Kitty is just awesome.

  • nnn

    n³ The unorthodox terminal file manager

  • nnn

  • bat

    A cat(1) clone with wings.

  • bat

  • pet

    Simple command-line snippet manager

  • pet

  • gist

    Potentially the best command line gister.

  • gist - needs ruby installed.

  • neovim

    Vim-fork focused on extensibility and usability

  • neovim

  • pdfarranger

    Small python-gtk application, which helps the user to merge or split PDF documents and rotate, crop and rearrange their pages using an interactive and intuitive graphical interface.

  • So, I guess, pdfarranger might be faster than PDFSam. https://github.com/pdfarranger/pdfarranger

  • media_management_scripts

    Set of tools for managing media libraries

  • This is pretty niche: https://github.com/raydouglass/media_management_scripts

  • BackDrop

    A cold storage backup tool for drives, folders, and network shares (by TechGeek01)

  • I made BackDrop to solve this. If I have, for example, two folders and two drives, and one folder fits on each drive, I don't want to fill one drive and then spill over to the second drive if it means splitting one folder between two drives. I want the cleanest way possible to copy data to as few drives as possible without splitting folders if they don't need to be.

  • ctrlfrything

    Search your current Windows Explorer folder with voidtools' Everything via Ctrl+F

  • Also pair this with CtrlFrything. Let's you Ctrl+F in a folder, and you can even enable the hijacking of Win+S so the global hotkey opens Everything instead of Windows search.

  • stash

    An organizer for your porn, written in Go. Documentation: https://docs.stashapp.cc

  • CommunityScripts

    This is a public repository containing plugin and utility scripts created by the Stash Community.

  • archivemount

    A fuse filesystem for mounting archives in formats supported by libarchive.

  • Instead of archiving collections of images in tar or zip files, img2pdf losslessly packs images into PDF files. This makes them really, really easy to browse without unpacking or archive-mounting them.

  • DAR

    DAR - Disk ARchive

  • dar is the only tool I know of that supports incremental backups to untrusted remote storage. All the remote sees are giant encrypted blobs.

  • image-downloader

    Download images from the web more easily. A browser extension for Google Chrome, Microsoft Edge, and Brave.

  • Copy Selected Links - I use this in combination with a text editor like Smultron on Mac. Cmd + f "https" and replace with "yt-dlp " and paste the full list into terminal usually does the trick when grabbing tons of links at once, which most frequently for me would be YouTube and Soundcloud links. Image Downloader - Easy and convenient, does its job 95% of the time. I should probably look into gallery-dl, but I prefer the precision in picking out ungrabbable images separately. https://chrome.google.com/webstore/detail/image-downloader/cnpniohnfphhjihaiiggeabnkjhpaldj Mute Tab - Helpful when capturing audio and you want to do other things. https://chrome.google.com/webstore/detail/mute-tab/blljobffcekcbopmkgfhpcjmbfnelkfg Save Image As PNG - My first and still my favorite anti-webp tool. Allow Right-Click - Always comes in handy. Channel Blocker - Helps filter out annoying channels taking over YouTube search results and wasting your time. SingleFile - "Save a complete page into a single HTML file", simple as that. I used to try to capture everything as PNG, which is now my backup option if SingleFile fails, which is rare. video downloader - CocoCut - This one picks up (most) audio files far better than any other extension I've used. I use this mostly for podcasts and rarely video. yt-dlp and CocoCut is my one-two punch, and Audio Hijack is my last resort when audio just can't be downloaded directly. Firefox addons:

  • TIBASIC-formulas

    Borderline cheating plug-and-chug programs for various mathematical classes/subjects

  • I used to do the exact same thing! I even put my programs on github: https://github.com/Scripter17/TIBASIC-formulas

  • MPF

    Redumper/Aaru/DiscImageCreator GUI in C#

  • MPF https://github.com/SabreTools/MPF

  • rclone

    "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files

  • Judging based on the release notes, rclone should be lightyears ahead

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts