whisper-rs
Rust bindings to https://github.com/ggerganov/whisper.cpp (by tazz4843)
DeepSpeed-MII
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed. (by microsoft)
| whisper-rs | DeepSpeed-MII | |
|---|---|---|
| 2 | 6 | |
| 584 | 1,669 | |
| - | 5.7% | |
| 8.7 | 8.6 | |
| 8 days ago | 1 day ago | |
| Rust | Python | |
| The Unlicense | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
whisper-rs
Posts with mentions or reviews of whisper-rs.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-10-10.
-
extract audio/speech as plain text (such as CC) from a video file (.MP4, .MOV)
You might want to look at whisper-rs which are bindings to whisper.cpp: https://github.com/tazz4843/whisper-rs.
- [P] Pure C/C++ port of OpenAI's Whisper
DeepSpeed-MII
Posts with mentions or reviews of DeepSpeed-MII.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-12-22.
- Stable Diffusion plus DeepSpeed
-
[D] When chatGPT stops being free: Run SOTA LLM in cloud
Microsoft/DeepSpeed-MII for an up 40x reduction on inference cost on Azure, this thing also supports int8 and fp16 bloom out of the box, but it fails on Azure due to instance size.
- Image Creation Time for each GPU.
-
Anyone tried DeepSpeed-MII with stablediffusion?
Haven't tried it yet but they have some example code here: https://github.com/microsoft/DeepSpeed-MII/blob/main/examples/local/txt2img-example.py
- [P] Pure C/C++ port of OpenAI's Whisper
What are some alternatives?
When comparing whisper-rs and DeepSpeed-MII you can also consider the following projects:
AITemplate - AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
whisper.cpp - Port of OpenAI's Whisper model in C/C++
XNNPACK - High-efficiency floating-point neural network inference operators for mobile, server, and Web
petals - 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
HIP-CPU - An implementation of HIP that works on CPUs, across OSes.
xformers - Hackable and optimized Transformers building blocks, supporting a composable construction.
rocm-gfx803
whisper - Robust Speech Recognition via Large-Scale Weak Supervision