OBS-captions-plugin
STT
Our great sponsors
| OBS-captions-plugin | STT | |
|---|---|---|
| 27 | 11 | |
| 928 | 2,131 | |
| - | 2.7% | |
| 0.0 | 0.6 | |
| over 1 year ago | about 2 months ago | |
| C++ | C++ | |
| GNU General Public License v3.0 only | Mozilla Public License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
OBS-captions-plugin
-
Twitch is not accessible to the deaf
If you'd rather use a plugin instead of an extension, this can work. This runs as a plugin within OBS. https://github.com/ratwithacompiler/OBS-captions-plugin
-
Idea I came up with this morning, not sure if it exists, but if someone wants to make it, here's the idea!
There are also OBS live captions plugins that you can install to pop up text as you speak: https://github.com/ratwithacompiler/OBS-captions-plugin
-
Bots that listens and responds to streamers in chat?
I wouldn't call it a regular/normal thing at all but it's very possible. Twitch does have an API that lets users connect their bots and there are many livestream Closed Captioning tools that can transcribe livestreams to text in real time.
-
Closed Captioning
Checkout https://github.com/ratwithacompiler/OBS-captions-plugin
-
Adding Closed Captions to an Amazon IVS Live Stream
The solution that we will look at in this post will focus on broadcasting to an Amazon Interactive Video Service (Amazon IVS) live stream from OBS Studio. OBS doesn't offer native support for captioning, but there are a number of plugins available that can perform the necessary speech to text conversion and publish the captions to an RTMP stream in the CEA-708/EIA-608 format that is supported by Amazon IVS. For this demo, I've chosen to use the OBS-captions-plugin by ratwithacompiler (GitHub and plugin page). To get started with this plugin, download it and install it. Once you've got it installed in OBS, click on Docks and make sure the Captions dock is enabled.
- Hello friends, I write a query. Does anyone know how to place subtitles in the stream in real time? that is, that the audio of the stream is translated and comes out in subtitle
-
Twitch Accessibility and Closed Captions
I think it would be a good addition, should be fairly simple to do with a plugin like this one: https://github.com/ratwithacompiler/OBS-captions-plugin
- How does he do the real time subtitles on his streams?
-
Introducing Whisper
I use two SST to live-translate audio that I listen to so I can look back (in paragraph form) to see things that I or the youtube has previously said: https://github.com/coqui-ai/STT https://github.com/ratwithacompiler/OBS-captions-plugin
- Does anyone know the plugin/method Jeff uses to get those live auto text captions?
STT
-
Rest in Peas: The Unrecognized Death of Speech Recognition (2010)
What has happened since then? I know Common Voice has come and gone https://en.wikipedia.org/wiki/Common_Voice https://github.com/coqui-ai/STT
And I've seen some neural approaches too
No idea where to look for comparisons though.
-
Numen - FOSS voice control for handsfree computing
I basically just used coqui stt https://github.com/coqui-ai/STT
-
Are there any OCR and Speech-to-Text services that are privacy friendly?
This speech-to-text works well: https://github.com/coqui-ai/STT. openai's "whisper" is probably better but I haven't tried it: https://towardsdatascience.com/transcribe-audio-files-with-openais-whisper-e973ae348aa7
-
Introducing Whisper
I use two SST to live-translate audio that I listen to so I can look back (in paragraph form) to see things that I or the youtube has previously said: https://github.com/coqui-ai/STT https://github.com/ratwithacompiler/OBS-captions-plugin
-
You can now tether any prod Vector to Wire's Open Source Escape Pod • thedroidyouarelookingfor
I did have to install Coqui STT and go-asticoqui manually before i was able to run Chipper.
-
Currently working on a custom Virtual Assistant ('Randy') to help automate things in my shed (mainly CNC equipment) and also perform basic tasks. This morning I was able to get it to publish events on my google calendar.
What do you use as STT? I have heard good things about coqui (https://github.com/coqui-ai/STT) and will use it for my Assistant-build.
- Speech to Text Best Resource
-
I put together a tutorial and overview on how to use DeepSpeech to do Speech Recognition in Python
If anyone is looking for a maintained version of DeepSpeech, checkout Coqui's repositories for STT and TTS. Coqui is lead by the engineers that used to work on DeepSpeech at Mozilla.
-
CoquiTTS: 🐸💬 - Open Source Text-to-Speech framework.
Link: https://github.com/coqui-ai/STT
- Mozilla Common Voice Adds 16 New Languages and 4,600 New Hours of Speech
What are some alternatives?
Retrieval-based-Voice-Conversion-WebUI - Easily train a good VC model with voice data <= 10 mins!
DeepSpeech - DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.
obs-websocket - Remote-control of OBS Studio through WebSocket
TTS - 🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
obs-studio - OBS Studio - Free and open source software for live streaming and screen recording
NeMo - A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
voice-changer - リアルタイムボイスチェンジャー Realtime Voice Changer
vosk-api - Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node
TTS - :robot: :speech_balloon: Deep learning for Text to Speech (Discussion forum: https://discourse.mozilla.org/c/tts)
flashlight - A C++ standalone library for machine learning
vakyansh-models - Open source speech to text models for Indic Languages
PaddleSpeech - Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.