Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX

1. mlx-examples

   1 34 8,722 5.7 Python

   Examples in the MLX framework

   

   Does this translate to other models or was whisper cherry picked due to it's serial nature and integer math? looking at https://github.com/ml-explore/mlx-examples/tree/main/stable_... seems to hint that this is the case:

   >At the time of writing this comparison convolutions are still some of the least optimized operations in MLX.

   I think the main thing at play is the fact you can have 64+G of very fast ram directly coupled to the cpu/gpu and the benefits of that from a latency/co-accessibility point of view.

   These numbers are certainly impressive when you look at the power packages of these systems.

   Worth considering/noting that the cost of m3 max system with the minimum ram config is ~2x the price of a 4090...

2. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. insanely-fast-whisper

   2 10 12,962 8.7 Jupyter Notebook

   

   How does this compare to insanely-fast-whisper though? https://github.com/Vaibhavs10/insanely-fast-whisper

   I think that not using optimizations allows this to be a 1:1 comparison, but if the optimizations are not ported to MLX, then it would still be better to use a 4090.

   Having looked at MLX recently, I think it's definitely going to get traction on Macs - and iOS when Swift bindings are released https://github.com/ml-explore/mlx/issues/15 (although there might be some C++20 compilation issue blocking right now).

4. mlx

   3 51 26,906 9.8 C++

   MLX: An array framework for Apple silicon

   

   How does this compare to insanely-fast-whisper though? https://github.com/Vaibhavs10/insanely-fast-whisper

   I think that not using optimizations allows this to be a 1:1 comparison, but if the optimizations are not ported to MLX, then it would still be better to use a 4090.

   Having looked at MLX recently, I think it's definitely going to get traction on Macs - and iOS when Swift bindings are released https://github.com/ml-explore/mlx/issues/15 (although there might be some C++20 compilation issue blocking right now).

5. faster-whisper

   4 28 23,557 6.8 Python

   Faster Whisper transcription with CTranslate2

   

   Could someone elaborate how is this accomplished and is there any quality disparity compared to original whisper?

   Repos like https://github.com/SYSTRAN/faster-whisper makes immediate sense about why it's faster than the original, but this one, not so much, especially considering it's even much faster.

6. cog-whisper-diarization

   5 1 235 5.5 Python

   Cog implementation of transcribing + diarization pipeline with Whisper & Pyannote

   

   I'll take this opportunity to ask for help: What's a good open source transcription and diarization app or work flow?

   I looked at https://github.com/thomasmol/cog-whisper-diarization and https://about.transcribee.net/ (from the people behind Audapolis) but neither work that well -- crashes, etc.

   Thank you!

7. WhisperLive

   6 7 4,066 7.7 Python

   A nearly-live implementation of OpenAI's Whisper.

   

   https://github.com/collabora/WhisperLive

   The is another one that uses huggingface's implementation, but I haven't tried it since my spec doesn't support flash-att2

8. whisper_streaming

   7 1 122 7.8 Python

   Whisper realtime streaming for long speech-to-text transcription and translation

   

Suggest a related project