Anyone know of a tool to align (existing) subtitles to audio along sentence boundaries?

• syncabook

  5 231 4.3 HTML

  📖🎧 A tool for creating ebooks with synchronized text and audio (EPUB3 with Media Overlays)

I've tried syncabook, but that didn't help. I've tried whisperX, to get word-level timings, but the results are pretty bad/unusable.

• whisperX

  24 8,965 8.4 Python

  WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

I've tried syncabook, but that didn't help. I've tried whisperX, to get word-level timings, but the results are pretty bad/unusable.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• aeneas

  4 2,379 0.0 Python

  aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)

You could try aeneas. Syncabook apparently uses the afaligner library, which says that it was inspired by aeneas but uses FastDTW to find an approximation to the optimal warping path. This might make it slightly less accurate than aeneas.

• afaligner

  1 76 3.9 Python

  📈 A forced aligner intended for synchronization of narrated text

You could try aeneas. Syncabook apparently uses the afaligner library, which says that it was inspired by aeneas but uses FastDTW to find an approximation to the optimal warping path. This might make it slightly less accurate than aeneas.

Suggest a related project