Kaldi Speech Recognition Toolkit VS PeerTube

Yeah, whisper is the closest thing we have, but even it requires more processing power than is present in most of these edge devices in order to feel smooth. I've started a voice interface project on a Raspberry Pi 4, and it takes about 3 seconds to produce a result. That's impressive, but not fast enough for Alexa.

From what I gather a Pi 5 can do it in 1.5 seconds, which is closer, so I suspect it's only a matter of time before we do have fully local STT running directly on speakers.

> Probably anathema to the space, but if the devices leaned into the ~five tasks people use them for (timers, weather, todo list?) could probably tighten up the AI models to be more accurate and/or resource efficient.

Yes, this is the approach taken by a lot of streaming STT systems, like Kaldi [0]. Rather than use a fully capable model, you train a specialized one that knows what kinds of things people are likely to say to it.

[0] http://kaldi-asr.org/

You can study CTC in isolation, ignoring all the HMM background. That is how CTC was also originally introduced, by mostly ignoring any of the existing HMM literature. So e.g. look at the original CTC paper. But I think the distill.pub article (https://distill.pub/2017/ctc/) is also good.

For studying HMMs, any speech recognition lecture should cover that. We teach that at RWTH Aachen University but I don't think there are public recordings. But probably you should find some other lectures online somewhere.

You also find a lot of tutorials for Kaldi: https://kaldi-asr.org/

Maybe check this book: https://www.microsoft.com/en-us/research/publication/automat...

The relation of CTC and HMM becomes intuitively clear once you get the concept of HMMs. Often in terms of speech recognition, it is all formulated as finite state automata (FSA) (or finite state transducer (FST), or weighted FST (WFST)), and the CTC FST just looks a bit different (simpler) than the traditional HMMs, but in all cases, you can think about having states with possible transitions.

This is all mostly about the modeling. The training is more different. For CTC, you often calculate the log prob of the full sequence over all possible alignments directly, while for HMMs, people often use a fixed alignment, and calculate framewise cross entropy.

I did some research on the relation of CTC training and HMM training: https://www-i6.informatik.rwth-aachen.de/publications/downlo...

- https://github.com/kaldi-asr/kaldi

Additionally, C++ may be used for extremely high levels of optimization even for cloud-based ML. Dlib and Kaldi are C++ libraries used as dependencies in Python codebases for computer vision and audio processing, for example. So if your application requires you to customize any functions similar to those libraries, then you'll need C++ knowhow.

Frameworks as well as toolkits like Kaldi were at first promoted by the research study area, yet nowadays used by both scientists and also market experts, reduced the access obstacle in the advancement of automatic speech recognition systems. Nonetheless, cutting edge methods need big speech data readies to achieve a usable system.

Hello. I'm trying to package the openfst library (here)[https://github.com/void-linux/void-packages/pull/39015] but a developer says 32-bit must be cross compiled from 64-bit. I see xbps-src has a nocross option, but I don't see a way to only cross compile. What do you think I should do? I have currently limited the archs to 64-bit ones. Here's my issue with the developer's response: https://github.com/kaldi-asr/kaldi/issues/4808 Thank you.

If you interested in unix-like software design and not yet familiar with kaldi toolkit, you definitely need to check it https://kaldi-asr.org

It extended Unix design with archives, control lists and matrices and enabled really flexible unix-like processing. For example, recognition of a dataset looks like this:

extract-wav scp:list.scp ark:- | compute-mfcc-feats ark:- ark:- | lattice-decoder-faster final.mdl HCLG.fst ark:- ark:- | lattice-rescore ark:- ark:'|gzip -c > lat.gzip'

Another example is gstreamer command line.

No, speaker diarization is not part of Whisper. There are open source projects - such as Kaldi [1], but it's hard to get them running if you are not an area expert.

[1] https://kaldi-asr.org/

State-of-the-art ASR, like what you get on smartphones, has unfortunately high resource requirements. Some recent smartphone models are able to run ASR on-device, but more typically, ASR is done by sending audio to a web service. Check out the (currently experimental) Web SpeechRecognition API in a Chrome browser. Here is a demo of the API in action. For something open source, check out Kaldi ASR.

PeerTube is a decentralized and federated alternative to YouTube. The goal of PeerTube is not to replace YouTube but to offer a viable alternative using the strength of ActivityPub and P2P protocols.

Being built on ActivityPub means PeerTube is able to be part of a bigger social network, the Fediverse (the Federated Universe). On the other hand, P2P technologies help PeerTube to solve the issue of money, inbound with all streaming platform : With PeerTube, you don't need to have a lot of bandwidth available on your server to host a PeerTube platform because all users (which didn't disable the feature) watching a video on PeerTube will be able to share this same video to other viewers.

If you are curious about PeerTube, I can't recommend you enough to check the official website (https://joinpeertube.org) to learn more about the project. If after that you want to try to use PeerTube as a content creator, you can try to find a platform available there to register or host yourself your own PeerTube platform on your own server.

The development of PeerTube is actually sponsored by Framasoft (https://framasoft.org), a french non-for-profit popular educational organization, a group of friends convinced that an emancipating digital world is possible, convinced that it will arise through actual actions on real world and online with and for you!

Framasoft is also involved in the development of Mobilizon, a decentralized and federated alternative to Facebook Events and Meetup.

If you want to contribute to PeerTube, feel free to:

    * report bugs and give your feedback on Github or on our forums (https://github.com/Chocobozzz/PeerTube/)

If you're looking for YouTube alternatives, you might be interested in PeerTube. PeerTube is to YouTube what Mastodon is to Twitter. (Plus PeerTube and Mastodon use the same federation technology. You can follow PeerTube accounts from inside Mastodon and vice versa.)

Hey! Just a rando here, but I would be interested in hearing your opinion as to where Peertube does well with this wish list and where it needs improvement.

https://joinpeertube.org

https://framablog.org/2023/11/28/peertube-v6-is-out-and-powe...

If you are curious about PeerTube, I can't recommend you enough to check the official website to learn more about the project. If after that you want to try to use PeerTube as a content creator, you can try to find a platform available there to register or host yourself your own PeerTube platform on your own server.

> YouTube (and other mainstream providers) solves user stories. The user story is "I want to find and watch interesting videos" and they nail it.

You miss another user story: IT department wants to self host a video distributing platform on their intranet and users need to embed video in intranet CMS (blogs, wikis, etc.) and they will watch those videos at home, at the office and in between places.

Thinking audience and monetization, basically it's thinking "youtube clone", and that narrows outlooks on what peertube brings to the table.

> The user story for this, judging by their homepage (https://joinpeertube.org), seems to be "I want a boring lecture on how bad Big Tech is"?

    What is PeerTube?

Exactly what you described exists and is called PeerTube.

https://joinpeertube.org

https://github.com/Chocobozzz/PeerTube

> Why don't you or someone else try starting one?

https://joinpeertube.org/

There are several instances, but that is not the solution to what the parent comment is pointing out. Videos are being published on YouTube because of network effect; it has become the defacto platform.

There already is an alternative to youtube. Peertube https://joinpeertube.org/

The problem is most content creators are only publishing on YouTube, so that is where you have to go. If you are a content creator please publish on peertube so we have options. If you know a creator, likewise encourage them to publish there.