Top 6 Jupyter Notebook speech-to-text Projects

vosk-api

59 7,025 5.9 Jupyter Notebook

Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node

Project mention: VOSK Offline Speech Recognition API | news.ycombinator.com | 2024-04-13

silero-models

32 4,546 4.7 Jupyter Notebook

Silero Models: pre-trained speech-to-text, text-to-speech and text-enhancement models made embarrassingly simple

Project mention: Weird A.I. Yankovic, a cursed deep dive into the world of voice cloning | news.ycombinator.com | 2023-10-02

I doubt it's currently actually "the best open source text to speech", but the answer I came up with when throwing a couple of hours at the problem some months ago was "Silero" [0, 1].
Following the "standalone" guide [2], it was pretty trivial to make the model render my sample text in about 100 English "voices" (many of which were similar to each other, and in varying quality). Sampling those, I got about 10 that were pretty "good". And maybe 6 that were the "best ones" (pretty natural, not annoying to listen to).
IIRC the license was free for noncommercial use only. I'm not sure exactly "how open source" they are, but it was simple to install the dependencies and write the basic Python to try it out; I had to write a for loop to try all the voices like I wanted. I ended using something else for the project for other reasons, but this could still be fairly good backup option for some use cases IMO.
  [0] https://github.com/snakers4/silero-models#text-to-speech

WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
whisper-diarization

5 1,985 7.2 Jupyter Notebook

Automatic Speech Recognition with Speaker Diarization based on OpenAI Whisper

Project mention: MacWhisper: Transcribe audio files on your Mac | news.ycombinator.com | 2023-08-23

https://github.com/MahmoudAshraf97/whisper-diarization
This project has been alright for transcribing audio with speaker diarization. A big finicky. The OpenAI model is better than other paid products(Descript, Riverside) so I’m looking forward to trying MacWhisper.

whisper-youtube

3 317 4.3 Jupyter Notebook

🔉 Youtube Videos Transcription with OpenAI's Whisper

Project mention: Magyar Youtube feliratozo v.1.1 (ingyenes colab) | /r/hungary | 2023-05-03

Source: https://colab.research.google.com/github/ArthurFDLR/whisper-youtube/blob/main/whisper_youtube.ipynb

converse

6 176 0.0 Jupyter Notebook

Conversational text Analysis using various NLP techniques
vid2cleantxt

1 156 0.0 Jupyter Notebook

Python API & command-line tool to easily transcribe speech-based video files into clean text

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).