very huge amount of photos (40k+) scattered across multiple hard drives and google photos

This page summarizes the projects mentioned and recommended in the original post on /r/selfhosted

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • czkawka

    Multi functional app to find duplicates, empty folders, similar images etc.

  • I recently just sorted about 100GB of family photos. First thing is to dump it all to 1 place. Next I used czkawka to remove all the duplicates. Then ran find . -exec jhead -n%Y-%m-%d-%H%M%S {} \; to rename all the photos based on when they were taken into a format like this 2020-12-26-011825.jpg. Finally I sorted all the photos into new folders based on the year.

  • rmlint

    Extremely fast tool to remove duplicates and other lint from your filesystem

  • I also use Rmlint but its not really intended for pictures and runs in command line.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • AntiDupl

    A program to search similar and defect pictures on the disk

  • Haven't tried it yet, but this looks promising. https://github.com/ermig1979/AntiDupl

  • darktable

    darktable is an open source photography workflow application and raw developer

  • I recently came across darktable. That might solve your problem. Let me know what's missing from this self hosted free solution.

  • photo-ingest

  • exiftool is awesome and the author is very responsive and helpful. It does a lot of the heavy lifting in various applications like GeoSetter. It is also very powerful. It is well worth the time and effort to get to know the tool and it's options. I used to use a few different incantations of exiftool by copy pasting them from notes. I got tired of doing that and eventually wrapped it up in some helper scripts I now use routinely on both Windows and Linux. The sources are on GitHub - photo-ingest - in case you're interested.

  • exiftool

    ExifTool meta information reader/writer

  • exiftool is awesome and the author is very responsive and helpful. It does a lot of the heavy lifting in various applications like GeoSetter. It is also very powerful. It is well worth the time and effort to get to know the tool and it's options. I used to use a few different incantations of exiftool by copy pasting them from notes. I got tired of doing that and eventually wrapped it up in some helper scripts I now use routinely on both Windows and Linux. The sources are on GitHub - photo-ingest - in case you're interested.

  • photoview

    Photo gallery for self-hosted personal servers (by photoview)

  • I used Photoview. Link your Archive, Album, and Nextcloud Photo upload folders as read-only to this app. It will provide users with 1) a list of time-sorted photos 2) face-recognition 3) album-sorted view. If you want something more individual photo focused, set up PixelFed - although this makes only sense in non-local network context photo sharing.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • PixelFed

    Photo Sharing. For Everyone.

  • I used Photoview. Link your Archive, Album, and Nextcloud Photo upload folders as read-only to this app. It will provide users with 1) a list of time-sorted photos 2) face-recognition 3) album-sorted view. If you want something more individual photo focused, set up PixelFed - although this makes only sense in non-local network context photo sharing.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts