audio_alignment
yt-whisper
audio_alignment | yt-whisper | |
---|---|---|
1 | 3 | |
11 | 1,317 | |
- | - | |
1.7 | 0.0 | |
12 months ago | 4 months ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
audio_alignment
-
YouTubeTranscript.com
This is a great idea; I had done something like this a couple of years ago for some specific set of videos (e.g. https://shreevatsa.net/tex/program/videos/s10/ — compare with https://youtubetranscript.com/?v=_0Cv1G_s4gQ for the same video), but never got around to making it general; glad someone has done it. It takes just a few lines of Javascript, using the Youtube API, to do this i.e. keeping the video and text in sync (just view source on either page to see the JS at the bottom).
Something like this can also help with audio recordings (generating the alignment automatically is called "forced alignment" and there are tools like "aeneas" for this). In case anyone's interested or wants to help (for Sanskrit texts): see https://github.com/shreevatsa/web-align-audio-text deployed at https://shreevatsa.net/ramayana/sarga/ and better version at https://github.com/avinashvarna/audio_alignment deployed at https://avinashvarna.github.io/audio_alignment/
yt-whisper
-
me in real life
#28 transcribe local files
-
YouTubeTranscript.com
Or even better, yt-whisper, which uses OpenAI's Whisper speech to text. I guess it'd be better to first check whether the video has captions first before Whispering, so maybe both your command and this one could be used together.
https://github.com/m1guelpf/yt-whisper
-
[P] Transcribe any podcast episode in just 1 minute with optimized OpenAI/whisper
With minimal changes to https://github.com/m1guelpf/yt-whisper i got a setup to transcribe subs from YouTube videos or local files bit it might take an hour or so running the large model on my CPU.
What are some alternatives?
gentle - gentle forced aligner
subsai - 🎞️ Subtitles generation tool (Web-UI + CLI + Python package) powered by OpenAI's Whisper and its variants 🎞️
ChatGPT-YouTube-summarizer - This Chrome extension lets you summarize YouTube videos using the ChatGPT.
YouWhisper - Convert YouTube videos to text using openai/whisper
tldwol - Web API that summarizes multimedia from various sources using modern AI tools.
glancer - Glance over some technical videos
auto-subtitle - Automatically generate and overlay subtitles for any video.
web-align-audio-text - Ramayana audio/text alignment website
ambuda - Main application code for Ambuda, a breakthrough Sanskrit library (ambuda.org)
malayalam_english_subtitle_generator - Malayalam to English Subtitle Generator for audio files using OpenAI's Whisper.