syncabook
storyteller
| syncabook | storyteller | |
|---|---|---|
| 5 | 3 | |
| 236 | - | |
| - | - | |
| 4.3 | - | |
| 4 months ago | - | |
| HTML | ||
| MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
syncabook
-
I made an open-source, self-hostable synced narration platform for ebooks
Amazing! I've made a similar ebooks-audiobooks aligner years ago: https://github.com/r4victor/syncabook. At that time, I chose to synthesize the text and align two audio sequences because I found texts-alignment approaches (including ML-based ones) too compute-intensive and inadequate for long texts. I see Storyteller works by aligning the texts. Could you give some view on how long it takes to sync a book?
Also, my experience was that audio and text versions are often very different (e.g. the audio having an intro missing from the text). It'd very interesting to know how well Storyteller handles such cases. Does it require manual audio/text editing or handle the differences automatically?
-
I decided to spruce up the eBook I'm reading with additional functionality (more info in comments)
Unfortunaly, this audiobook isn't synchorized to the text on Kindle. So, in order to synchronize the epub and audio myself, initially, I tried using syncabook, but the results weren't great for some reason. I then tried using OpenAI's Whisper to generate the text from the audio. This might've given decent results, but ultimately I decided I wanted to keep the book's formatting (paragraphs, emphasis, etc.)
-
Anyone know of a tool to align (existing) subtitles to audio along sentence boundaries?
I've tried syncabook, but that didn't help. I've tried whisperX, to get word-level timings, but the results are pretty bad/unusable.
-
Have you found a way to get epub3 audio-ebooks?
From searching a bit I found https://github.com/r4victor/syncabook this might help anyone intrigued about the idea. I suspect this is the tool you're talking about? Your post is really a long form question, and could have been a lot shorter.
-
[Intermediate] Ultimate Guide to Making Japanese Audiobooks with Subtitles (and Where to Get Them)
This software can generate epubs with audio completely automatically for a lot of simpler languages. The problem is it doesn't support Japanese.
storyteller
-
I made an open-source, self-hostable synced narration platform for ebooks
There's an open ticket for languages other than English! https://gitlab.com/smoores/storyteller/-/issues/10. If you want to take a look, please do! I don't have any contributing guidelines yet, unfortunately, but they'll probably come soon. I think Whisper does have Cantonese and Mandarin support, so it should be possible to add support for those languages, though we'll have to look into nltk support for sentence tokenization as well!
What are some alternatives?
thorium-reader - A cross platform desktop reading app, based on the Readium Desktop toolkit
kobo-book-downloader - A tool to download and remove DRM from your purchased Kobo.com ebooks and audiobooks.
syosetu2epub - Python package that takes a link to a Syosetu web novel and converts it to an e-reader friendly EPUB file
tools - The Standard Ebooks toolset for producing our ebook files.
epubcheck - The conformance checker for EPUB publications
aeneas - aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)
whisper - Robust Speech Recognition via Large-Scale Weak Supervision
whisperX - WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)
awesome-piracy - A curated list of awesome warez and piracy links
afaligner - 📈 A forced aligner intended for synchronization of narrated text