How can I create a dataset to refine Whisper AI from old videos with subtitles?

• finetuner

  36 1,466 5.5 Python

  Discontinued :dart: Task-oriented embedding tuning for BERT, CLIP, etc.

  

  You can try creating your own dataset. Get some audio data that you want, preprocess it, and then create a custom dataset you can use to fine tune. You could use finetuners like these if you want as well.

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• community-events

  8 397 7.2 Jupyter Notebook

  Place where folks can contribute to 🤗 community events

  

  For the training, I extremely recommend checking out the Whisper Fine-Tuning Event. It has a python script to train in one command, tons of tips, even a walkthrough video.

• mimic-recording-studio

  4 493 0.0 JavaScript

  Mimic Recording Studio is a Docker-based application you can install to record voice samples, which can then be trained into a TTS voice with Mimic2

  

  I weirdly can't find a great off-the-shelf app for this. l'd love to know if anyone finds one. Most stuff seems to be for recording data for Text To Speech (going the other way). Mimic Recording Studio looks the best. Then there's speech training recorder and TTS Dataset Creator (video). You don't have to worry about audio quality as much as they do.

• speech-training-recorder

  1 39 10.0 Python

  Simple GUI application to help record audio dictated from given text prompts, for use with training speech recognition or speech synthesis.

  I weirdly can't find a great off-the-shelf app for this. l'd love to know if anyone finds one. Most stuff seems to be for recording data for Text To Speech (going the other way). Mimic Recording Studio looks the best. Then there's speech training recorder and TTS Dataset Creator (video). You don't have to worry about audio quality as much as they do.

Suggest a related project