Our great sponsors
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
TheFrenchGhostys-Ultimate-YouTube-DL-Scripts-Collection
The ultimate collection of scripts for YouTube-DL.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
yt-channels-archive
A CLI tool to backup multiple YouTube channels along with their associated metadata and thumbnails. In the highest available quality.
-
library
An index for your archive. 70+ CLI tools to help you build, browse, and manage your media library. (by chapmanjacobd)
Working on some of the groundwork of it now in https://github.com/Owez/yark/pull/57. Higher quality might be a bigger issue to tackle because of dependence on ffmpeg but it'll be done in v1.3, slated for release in about a months time.
I'm going to cap videos to 1080p by default and have a config setting to customize this.
I'm a big fan of the historical information that Yark shows.
Arrimus 3D recently replacing a large chunk of their 3D modeling tutorials with religious content was a pretty big lightbulb moment for me that so much of the content I rely on - not just for the initial learning of a new skill, but as a continual reference when I forget something - is so fragile.
I immediately bought a NAS and began backing up everything that I gleam even the tiniest bit of learning from using a similar project, TubeArchivist[0]. Projects like this are really important for maintaining all of the great knowledge on the web.
[0] https://github.com/tubearchivist/tubearchivist
If you want to provide an option to upload artifacts to the Internet Archive, you could crib off of https://github.com/bibanon/tubeup
I run mine with cron and it puts files in a special folder for plex: https://github.com/nburns/utilities/blob/master/youtube.fish
Pulls from my watch later playlist which is quite handy
You might be intereseted in these youtube archive scripts: https://github.com/TheFrenchGhosty/TheFrenchGhostys-Ultimate...
You might be intereseted in these youtube archive scripts: https://github.com/TheFrenchGhosty/TheFrenchGhostys-Ultimate...
Seconding tubearchivist. One of the killer features IMO is the browser extension [0], which adds a button on every video to send that video to the server to archive.
[0] https://github.com/tubearchivist/browser-extension
I like it, it's much better than what I've used previously.
I made a docker container to run it (https://github.com/na4ma4/docker-yark), when I get time I'll do a PR if you're interested so it isn't a separate project.
(I'll also fix it so the host is a command line argument not just changing the binding from 127.0.0.1 to 0.0.0.0)
Here's a similar project we've been working on, it's running 24/7
https://github.com/VeemsHQ/yt-channels-archive
This just provides the latest HQ of the videos + thumbs & metadata, no historic information such as changes in video titles.
A while ago I did something similar. I'm already downloading various playlists via yt-dlp and wrote a [web interface](https://github.com/Mikescher/youtube-dl-viewer) to view them.
My biggest annoyance at the time was importing my existing videos (and converting them to a streamable format, generating thumbnails and hover-previews etc).
I also archive many playlists with some code I wrote but I don't use a GUI.
https://github.com/chapmanjacobd/library/blob/f778e22bf80c58...
My focus is on error handling and trying to differentiate between unrecoverable errors and recoverable ones (try different proxy) but there's still a lot of work to be done.
Also look into https://github.com/swolegoal/squid-dl
I also archive many playlists with some code I wrote but I don't use a GUI.
https://github.com/chapmanjacobd/library/blob/f778e22bf80c58...
My focus is on error handling and trying to differentiate between unrecoverable errors and recoverable ones (try different proxy) but there's still a lot of work to be done.
Also look into https://github.com/swolegoal/squid-dl
This is how I accomplish basically the same thing - https://gist.github.com/Gestas/30ac0c3a07404174d0d7b66068221....
It requires a local file with a list of channels/playlists. I use Jellyfin (https://jellyfin.org/) as the frontend/video player.