whisper-timestamped
speechbrain
whisper-timestamped | speechbrain | |
---|---|---|
2 | 26 | |
1,547 | 7,914 | |
7.4% | 2.8% | |
8.1 | 9.8 | |
17 days ago | 4 days ago | |
Python | Python | |
GNU Affero General Public License v3.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
whisper-timestamped
-
Show HN: AI Dub Tool I Made to Watch Foreign Language Videos with My 7-Year-Old
Yes. But Whisper's word-level timings are actually quite inaccurate out of the box. There are some Python libraries that mitigate that. I tested several of them. whisper-timestamped seems to be the best one. [0]
[0] https://github.com/linto-ai/whisper-timestamped
-
AI-assisted removal of filler words from video recordings
whisper-timestamped, which is a layer on top of the Whisper set of models enabling us to get accurate word timestamps and include filler words in transcription output. This transcriber downloads the selected Whisper model to the machine running the demo and no third-party API keys are required.
speechbrain
- SpeechBrain 1.0: A free and open-source AI toolkit for all things speech
- FLaNK Stack Weekly 22 January 2024
-
[D] Training ASR model using SpeechBrain
You likely have a very broken sample in one of your batches. It looks like your training actually went through a few batches before it horked the error at you. A quick google shows a similar issue in the github repo: https://github.com/speechbrain/speechbrain/issues/649 .
-
Whisper.cpp
https://github.com/ggerganov/whisper.cpp https://speechbrain.github.io/
-
[D] What is the best open source text to speech model?
I don't know if it's the best, but Speechbrain is supposed to be state of the art.
-
[D] What's stopping you from working on speech and voice?
- https://github.com/speechbrain/speechbrain
- Specific Voice recognition
- How to get high-quality, low-cost Speech-to-Text transcription?
- [D] Speech Enhancement SOTA
- Speaker diarization
What are some alternatives?
pywhisper - openai/whisper + extra features
espnet - End-to-End Speech Processing Toolkit
wav2vec - pure numpy implementation of wav2vec 2.0
pyannote-audio - Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding
pyannote-whisper
Resemblyzer - A python package to analyze and compare voices with deep learning
SincNet - SincNet is a neural architecture for efficiently processing raw audio samples.
ukrainian-onnx-model - An ONNX model for speech recognition of the Ukrainian language
FFmpeg - Mirror of https://git.ffmpeg.org/ffmpeg.git
zeta - Build high-performance AI models with modular building blocks
NeMo - A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)