mfcc-rust
DeepFilterNet
Our great sponsors
mfcc-rust | DeepFilterNet | |
---|---|---|
5 | 10 | |
16 | 1,914 | |
- | - | |
5.8 | 9.1 | |
9 months ago | 14 days ago | |
Rust | Python | |
Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
mfcc-rust
-
Real-Time Noise Suppression for PipeWire writen in Rust
hey, quick question. do you mind if I use your stft function in the speech preprocessing library I've been working on? we've been trying to add support for doing mel spectrograms to build a runner for openwakeword, but progress is pretty slow because I've been soloing something I really don't have the right background for(I've never directly studied or worked with signal processing)
-
Hey Rustaceans! Got a question? Ask here (23/2023)!
So I've been working on an speech preprocessing library for rust for a minute now. The tl;dr is it contains functions related to preprocessing audio for use in speech-centric models. I've run into a situation where I'm running against a few conflicting design constraints and trying to figure out the best way to handle state for a set of functions.
-
I want to contribute in a big project
we could always use contributors for mfcc-rust/speechsauce(we're planning on changing the name as it's not limited to just computing mfcc's).
-
HELP NEEDED: Using RUST and open source tools for reliable wake-word detection :tuerca_y_perno:
The code has comments and in the GitHub issues is written what's missing, the goal is to mimic functionality from NumPy not present in NDArray (a library for maths operations). You can find the code here: https://github.com/secretsauceai/mfcc-rust. Take a look, if you feel that you can give a hand, that would be amazing!!! Let's make a new exciting voice future!!!
-
Make your own custom wakeword and other FOSS voice assistant solutions
This release represents the first phase in the wakeword project, we are working on a Rust wakeword engine based on Precise and a SpeechPy MFCC port in Rust so that user's can run the wakeword easily on their phone and other devices. It is hard to believe that there aren't any current good solutions to running a modern FOSS wakeword engine on a phone in real time. We want to change that and allow everyone access to this technology, with their own wakeword of choice.
DeepFilterNet
-
Anyone know of a good TTS pipeline for raw speech data?
You mean remove background noise and transcribe? Then you can use DeepFilterNet to remove noise, and Whisper to transcribe.
-
Open Source Libraries
Rikorose/DeepFilterNet: A Low Complexity Speech Enhancement Framework for Full-Band Audio (48kHz) using on Deep Filtering
- DeepFilterNet: Noise supression using deep filtering
-
Linux Audio Noise suppression using deep filtering in Rust
It looks like the library in Rust is using `tract-onnx` to do the inference: https://github.com/Rikorose/DeepFilterNet/blob/2a84d2a1750a5... I am wondering whether using Python for research, training in big data center, and Rust at edge for efficient inference would be a trend in the future. We do have a larger community of C++ right now for inference (e.g. ggml). But Rust crate as component to build applications of AI is joy to use.
-
Real-Time Noise Suppression for PipeWire writen in Rust
Repo: https://github.com/Rikorose/DeepFilterNet
What are some alternatives?
openWakeWord - An open-source audio wake word (or phrase) detection framework with a focus on performance and simplicity.
NoiseTorch - Real-time microphone noise suppression on Linux.
secret_sauce_ai - Secret Sauce AI: a coordinated community of tech minded AI enthusiasts
audio-webui - A webui for different audio related Neural Networks
TX-2-simulator - Simulator for the pioneering TX-2 computer
noise-repellent - Lv2 suite of plugins for broadband noise reduction
precise-wakeword-model-maker - Automated, end-to-end wakeword model maker using the Precise Wakeword Engine
PiDTLN - Apply machine learning model DTLN for noise suppression and acoustic echo cancellation on Raspberry Pi
glados-voice-assistant - DIY Voice Assistant based on the GLaDOS character from Portal video game series. Works with home assistant!
wenet - Production First and Production Ready End-to-End Speech Recognition Toolkit
NLU-snips-converter - Quick and dirty solution to convert CSV training data into Snips JSON format and train an engine
rnnoise - Recurrent neural network for audio noise reduction