common-voice VS PySyft

Mozillas Common Voice Project (https://commonvoice.mozilla.org/) is creating an open dataset for many minority languages to make it easier to support them in STT systems. If you speak one of these languages please consider donating a few minutes of your voice.

> it was not at all obvious to me there was some way of speeding up getting a language in the first place.

Yeah, that's the biggest failing of Common Voice in my opinion. Getting a new language up to speed could be much improved by simply adding a few links to documentation, but even the existing links are broken, which I reported in March 2022... https://github.com/common-voice/common-voice/issues/3637

> I have no interest in wasting time contributing to a UI translation I actively don't want to be subjected to

Translating the UI may still help you get other people to record, even if you don't want to use it yourself.

> I'll see if I can submit some sentences at least

If you want to go faster, there's also a project to extract sentences from Wikipedia etc. in small doses Mozilla's lawyers and Wikimedia's lawyers have agreed are fair use. I think you'd only need to define how Norwegian Bokmål separates sentences. (E.g. after a period but not if it's a common abbreviation like "etc." in the preceding sentence.)

There is a lot of TTS and SST development going on (https://github.com/mozilla/TTS; https://github.com/mozilla/DeepSpeech; https://github.com/common-voice/common-voice). That is the only way they work: Contributions from the wild.

Since you're interested in STT and TTS, let me just plug in Mozilla's Common Voice, a way for everyone to contribute to an open source data set for STT. You can record yourself or verify other people's recordings!

[커먼보이스 전자우편](mailto:[email protected]) || Common Voice || Korean Language Homepage || FAQs || Speaking Aloud and Reviewing Recordings || Sentence Collector || NVidia/NeMo

How can it be used for transcription?

In their website I only see an interface for either uploading audio or submitting transcriptions:

https://commonvoice.mozilla.org/es

The Github repo they mention (https://github.com/common-voice/common-voice) seems to be just that sample collection software. I do not see where I can download the software to transcribe audio.

A practical example: in the speech community, getting good results on datasets such as TIMITwould not be revolutionary, since it's super small and very old. On the contrary, things like Common Voice (which is constantly crowd-sourced) would be much more impactful. Just my two cents :)

https://github.com/OpenMined/PySyft - Federated Learning data science

Incentives are much harder but smart contracts can handle the tech part.

Going this route eventually you quickly have "quantum AI app store" and your system of government is a 12GB download. Can't even say if it's a good idea compared to e.g. anarcho-primitivism.

Something that maybe can help keeping sensor specs secret while still getting critical information out: https://github.com/OpenMined/PySyft

Love this kind of project. To me this is just like https://github.com/open-quantum-safe/oqs-demos/ or https://github.com/OpenMined/PySyft or even k3s so often mentioned in this sub in the sense that I personally don't have a need for it. Yet I find it amazing that us, random curious geeks, have access to this kind of mind blowing technologies for basically free.

Or do I have to actually simulate the whole client server thing because thats how these frameworks do it - Flower and Pysyft .

Some of the technologies which could be integrated include differential privacy, distributed online machine learning, misinformation resilience and multi-party computation, all within the context of smart contracts and bioinformatics.

I think this is how it will be done. Look up PySift for how we can extract high-level insights from private datasets while preserving granular privacy.

What you are talking about is privacy-focused fed ML. Google FLOC is actually trying to achieve something similar. If you are interested in building something for yourself, check this out. https://github.com/OpenMined/PySyft