WhisperLive
WhisperFusion
| WhisperLive | WhisperFusion | |
|---|---|---|
| 4 | 3 | |
| 1,253 | 1,397 | |
| 17.0% | 3.5% | |
| 9.4 | 8.7 | |
| 7 days ago | about 2 months ago | |
| Python | Python | |
| MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
WhisperLive
-
Show HN: WhisperFusion – Ultra-low latency conversations with an AI chatbot
Everything runs locally, we use:
- WhisperLive for the transcription - https://github.com/collabora/WhisperLive
-
WhisperSpeech – An Open Source text-to-speech system built by inverting Whisper
Check out WhisperLive: https://github.com/collabora/WhisperLive
If you're grappling with the slow march from cool tech demos to real-world language model apps, you might wanna check out WhisperLive. It's this rad open-source project that’s all about leveraging Whisper models for slick live transcription. Think real-time, on-the-fly translated captions for those global meetups. It's a neat example of practical, user-focused tech in action. Dive into the details on their GitHub page
-
Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX
https://github.com/collabora/WhisperLive
The is another one that uses huggingface's implementation, but I haven't tried it since my spec doesn't support flash-att2
-
Triple Threat: The Power of Transcription, Summary, and Translation
Curious to see how this works? Check out our demo page - https://col.la/transcription to generate your own transcription, summary, and translation, or use our browser extension - https://github.com/collabora/WhisperLive to get live transcriptions.
WhisperFusion
- FLaNK Stack 05 Feb 2024
- Show HN: WhisperFusion – Ultra-low latency conversations with an AI chatbot
-
WhisperFusion: Ultra-low latency conversations with an AI chatbot
WhisperFusion is fully open-source - https://github.com/collabora/WhisperFusion
What are some alternatives?
cog-whisper-diarization - Cog implementation of transcribing + diarization pipeline with Whisper & Pyannote
WhisperSpeech - An Open Source text-to-speech system built by inverting Whisper.
whisper-writer - 💬📝 A small dictation app using OpenAI's Whisper speech recognition model.
metaflow - :rocket: Build and manage real-life ML, AI, and data science projects with ease!
obs-zoom-and-follow - Dynamic zoom and mouse tracking script for OBS Studio
FLiPStackWeekly - FLaNK AI Weekly covering Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Ozone, Apache Pulsar, and more...
gpt_chatbot - This chatbot lets you use your microphone to communicate with GPT-4. It uses the OpenAI text to speech to respond with a voice. It uses Pinecone to store long term information and retrieves it to create context. API keys for OpenAI and Pinecone required. Tested on Windows
stable_diffusion.openvino
whisper_streaming - Whisper realtime streaming for long speech-to-text transcription and translation
openvino-ai-plugins-gimp - GIMP AI plugins with OpenVINO Backend
gpt-voice-conversation-chatbot - Allows you to have an engaging and safely emotive spoken / CLI conversation with the AI ChatGPT / GPT-4 while giving you the option to let it remember things discussed.
onnxruntime - ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator