Top 23 Python speech-recognition Projects

speech-recognition

• Add a project

• transformers

  187 132,909 10.0 Python

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  

  Project mention: How to Learn Generative AI: A Step-by-Step Guide | dev.to | 2024-09-23

  Play around with OpenAI’s GPT models and Hugging Face's Transformers library.

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• whisperX

  27 11,720 7.1 Python

  WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

  Project mention: WhisperX: Precise ASR with Word-Level Timestamps and Diarization | news.ycombinator.com | 2024-09-05

• faster-whisper

  24 11,628 8.0 Python

  Faster Whisper transcription with CTranslate2

  

  Project mention: Self-hosted offline transcription and diarization service with LLM summary | news.ycombinator.com | 2024-05-26

  I've been using this:

  https://github.com/bugbakery/transcribee

  It's noticeably work-in-progress but it does the job and has a nice UI to edit transcriptions and speakers etc.

  It's running on the CPU for me, would be nice to have something that can make use of a 4GB Nvidia GPU, which faster-whisper is actually able to [1]

  https://github.com/SYSTRAN/faster-whisper?tab=readme-ov-file...

• PaddleSpeech

  6 10,970 7.2 Python

  Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

  

• speechbrain

  27 8,624 9.7 Python

  A PyTorch-based Speech Toolkit

  

  Project mention: Speaker Diarization in Python | dev.to | 2024-08-22

  Simple Diarizer Simple Diarizer is a speaker diarization library that utilizes pretrained models from SpeechBrain . To get started with simple_diarizer, follow these steps:

• SpeechRecognition

  16 8,356 8.2 Python

  Speech recognition module for Python, supporting several engines and APIs, online and offline.

  Project mention: help with script (beginner) | /r/learnpython | 2023-12-07

  Start and Stop Listening Example

• espnet

  15 8,346 9.9 Python

  End-to-End Speech Processing Toolkit

  

  Project mention: WhisperSpeech – An Open Source text-to-speech system built by inverting Whisper | news.ycombinator.com | 2024-01-17

  You might check out this list from espnet. They list the different corpuses they use to train their models sorted by language and task (ASR, TTS etc):

  https://github.com/espnet/espnet/blob/master/egs2/README.md

• FunASR

  2 6,179 9.9 Python

  A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.

  

  Project mention: FunASR: Fundamental End-to-End Speech Recognition Toolkit | news.ycombinator.com | 2024-01-13

• wenet

  5 4,085 9.4 Python

  Production First and Production Ready End-to-End Speech Recognition Toolkit

  

• Porcupine  

  31 3,706 8.4 Python

  On-device wake word detection powered by deep learning

  

• distil-whisper

  10 3,538 9.0 Python

  Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.

  

  Project mention: New OpenAI Whisper model: "turbo" | news.ycombinator.com | 2024-09-30

  Details will be shared tomorrow, but from what I have read they have distilled the large model decoder into this turbo that only has 4 layers instead of 32, the encoder should remain the same size. Similar to https://github.com/huggingface/distil-whisper but the model is distilled using multilingual data instead of just English, and the decoder is 4 layers instead of 2.

• lingvo

  1 2,811 8.1 Python

  Lingvo

  

• whisper-asr-webservice

  11 1,988 7.3 Python

  OpenAI Whisper ASR Webservice API

• whisper-timestamped

  2 1,913 8.1 Python

  Multilingual Automatic Speech Recognition with word-level timestamps and confidence

  

  Project mention: Show HN: AI Dub Tool I Made to Watch Foreign Language Videos with My 7-Year-Old | news.ycombinator.com | 2024-02-28

  Yes. But Whisper's word-level timings are actually quite inaccurate out of the box. There are some Python libraries that mitigate that. I tested several of them. whisper-timestamped seems to be the best one. [0]

  [0] https://github.com/linto-ai/whisper-timestamped

• lip-reading-deeplearning

  1 1,820 10.0 Python

  :unlock: Lip Reading - Cross Audio-Visual Recognition using 3D Architectures

• kalliope

  4 1,711 0.0 Python

  Kalliope is a framework that will help you to create your own personal assistant.

  

• Dragonfire

  2 1,384 0.0 Python

  the open-source virtual assistant for Ubuntu based Linux distributions

  

• whisper-standalone-win

  4 1,188 8.8 Python

  Whisper & Faster-Whisper standalone executables for those who don't want to bother with Python.

  Project mention: Whisper-WebUI | news.ycombinator.com | 2024-08-21

  On Windows I use whisper-standalone-win: https://github.com/Purfview/whisper-standalone-win

  It has a few customization features that are nice: https://github.com/Purfview/whisper-standalone-win/discussio...

  Works miles better than plain faster-whisper, in my experience. Not sure if there's wildcard support but that's easily scripted.

• SpeechT5

  4 1,163 7.1 Python

  Unified-Modal Speech-Text Pre-Training for Spoken Language Processing

  

• SincNet

  3 1,115 0.0 Python

  SincNet is a neural architecture for efficiently processing raw audio samples.

• kaldi-gstreamer-server

  4 1,069 0.0 Python

  Real-time full-duplex speech recognition server, based on the Kaldi toolkit and the GStreamer framwork.

• quillman

  7 1,030 9.1 Python

  A chat app that transcribes audio in real-time, streams back a response from a language model, and synthesizes this response as natural-sounding speech.

  

  Project mention: ChatGPT Voice Announced (By Greg Brockman) | news.ycombinator.com | 2023-11-21

  https://github.com/modal-labs/quillman

  I built something similar using WebKit speech recognition but that's limited to Chromium.

• SALMONN

  2 996 7.9 Python

  SALMONN: Speech Audio Language Music Open Neural Network

  

  Project mention: Comparing Humans, GPT-4, and GPT-4V on Abstraction and Reasoning Tasks | news.ycombinator.com | 2023-11-19

  > In other words, if you express a problem in a more complicated space (e.g. a visual problem, or an abstract algebra problem), you will not be able to solve it in the smaller token space, there's not enough information

  You're aware multimodel transformers do exactly this?

  https://github.com/bytedance/SALMONN

Python speech-recognition related posts

• Show HN: Auto Transcribe/Subtitle Videos – Python OpenAI Whisper Wrapper and GUI

  1 project | news.ycombinator.com | 3 Oct 2024

• New OpenAI Whisper model: "turbo"

  2 projects | news.ycombinator.com | 30 Sep 2024

• WhisperX: Precise ASR with Word-Level Timestamps and Diarization

  1 project | news.ycombinator.com | 5 Sep 2024

• WhisperX: Precise ASR with Word-Level Timestamps and Speaker Diarization

  1 project | news.ycombinator.com | 3 Sep 2024

• OctoTube: Voice Search for YouTube

  1 project | dev.to | 22 Aug 2024

• OTranscribe: A free and open tool for transcribing audio interviews

  8 projects | news.ycombinator.com | 9 Aug 2024

• StreamSpeech: "All in One" model for simultaneous ASR, translation and TTS

  1 project | news.ycombinator.com | 17 Jun 2024
• A note from our sponsor - SaaSHub
  www.saashub.com | 4 Oct 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!