Faster Whisper Transcription with CTranslate2

• tinydiarize

  2 364 6.0 Python

  Minimal extension of OpenAI's Whisper adding speaker diarization with special tokens

Not that I can see, the developer's roadmap[1] currently is at writing a blogpost about it & trying different sampling methods, expanding to the large model looks to be a long way off (which is a real pity, even if there was just a finetune of large for english that would be a big help over the existing small english finetune).

Could you go into more detail about your workflow? I'd been considering a two-pass approach myself until I discovered tinydiarize mentioned in whisper.cpp's --help text

1: https://github.com/akashmjn/tinydiarize#roadmap

• faster-whisper

  23 8,899 8.1 Python

  Faster Whisper transcription with CTranslate2

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• whisper-diarization

  5 2,019 6.8 Jupyter Notebook

  Automatic Speech Recognition with Speaker Diarization based on OpenAI Whisper

The project page mentions whisper-diarization (speaker recognition) as a user of faster-whisper. I've been in the market for that, definitely going to try it out.

https://github.com/MahmoudAshraf97/whisper-diarization

• CTranslate2

  14 2,825 8.9 C++

  Fast inference engine for Transformer models

  

The original Whisper implementation from OpenAI uses the PyTorch deep learning framework. On the other hand, faster-whisper is implemented using CTranslate2 [1] which is a custom inference engine for Transformer models. So basically it is running the same model but using another backend, which is specifically optimized for inference workloads.

[1] https://github.com/OpenNMT/CTranslate2

Suggest a related project