afaligner
audio_alignment
Our great sponsors
| afaligner | audio_alignment | |
|---|---|---|
| 1 | 1 | |
| 76 | 11 | |
| - | - | |
| 3.9 | 1.7 | |
| over 1 year ago | 12 months ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
afaligner
-
Anyone know of a tool to align (existing) subtitles to audio along sentence boundaries?
You could try aeneas. Syncabook apparently uses the afaligner library, which says that it was inspired by aeneas but uses FastDTW to find an approximation to the optimal warping path. This might make it slightly less accurate than aeneas.
audio_alignment
-
YouTubeTranscript.com
This is a great idea; I had done something like this a couple of years ago for some specific set of videos (e.g. https://shreevatsa.net/tex/program/videos/s10/ — compare with https://youtubetranscript.com/?v=_0Cv1G_s4gQ for the same video), but never got around to making it general; glad someone has done it. It takes just a few lines of Javascript, using the Youtube API, to do this i.e. keeping the video and text in sync (just view source on either page to see the JS at the bottom).
Something like this can also help with audio recordings (generating the alignment automatically is called "forced alignment" and there are tools like "aeneas" for this). In case anyone's interested or wants to help (for Sanskrit texts): see https://github.com/shreevatsa/web-align-audio-text deployed at https://shreevatsa.net/ramayana/sarga/ and better version at https://github.com/avinashvarna/audio_alignment deployed at https://avinashvarna.github.io/audio_alignment/
What are some alternatives?
aeneas - aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)
gentle - gentle forced aligner
whisperX - WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)
YouWhisper - Convert YouTube videos to text using openai/whisper
syncabook - 📖🎧 A tool for creating ebooks with synchronized text and audio (EPUB3 with Media Overlays)
ambuda - Main application code for Ambuda, a breakthrough Sanskrit library (ambuda.org)
yt-whisper - Using OpenAI's Whisper to automatically generate YouTube subtitles
web-align-audio-text - Ramayana audio/text alignment website
ChatGPT-YouTube-summarizer - This Chrome extension lets you summarize YouTube videos using the ChatGPT.
glancer - Glance over some technical videos
whisper.cpp - Port of OpenAI's Whisper model in C/C++