ddsp
Kornia
Our great sponsors
ddsp | Kornia | |
---|---|---|
3 | 11 | |
2,773 | 9,323 | |
1.5% | 2.1% | |
3.4 | 9.4 | |
about 2 months ago | 3 days ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ddsp
-
Making Synthesized Sounds More Acoustic
You can actually use thousands of oscillators, which is what Magenta did with their differentiable DSP (DDSP) approach to modeling acoustic instruments including singing:
https://magenta.tensorflow.org/ddsp-vst
https://magenta.tensorflow.org/ddsp
I doesn't sound realistic but it is expressive in an unusual way.
-
I need to learn audio processing in Python.
Have you checked out DDSP from magenta? Iām not sure what kind of learning you are trying to implement but they provide a lot of standard signal processing components that are differentiable so you can use them as part of a neural net. There are a handful of collabs that serve as interactive tutorials and the documentation is not bad, I did my bachelors thesis on the topic so I got quite stuck into this for a while
-
Kornia: Differential Computer Vision
In case you're asking about the parent comment (s/Differential/Differentiable), it means the title should be "differentiable CV" (instead of "differential CV").
"Differentiable" describes some computation for which derivatives can be computed. "Differential" is a more general term which means that something has to do with differences, e.g. differential equations deal with equations that specify how things change together.
With the recent surge in deep learning came significant improvements in optimization techniques and hardware, making it feasible to formulate some computations in a differentiable manner. Doing that allows one to optimize the computation process relatively efficiently, at least in theory. Some other examples: differentiable programming[0] (other differentiable techniques are a subset of this), differentiable rendering[1], differentiable signal processing[2].
[0] https://en.wikipedia.org/wiki/Differentiable_programming
Kornia
-
[News] Kornia 0.6.6: ParametrizedLine API, load_image support for Apple Windows Developer, integration demos with Hugging Face and many more.
š https://github.com/kornia/kornia/releases/tag/v0.6.6
- [P] Kornia: Differential Computer Vision
- Kornia: Differential Computer Vision
-
Hacker News top posts: May 10, 2022
Kornia: Differential Computer Vision\ (3 comments)
- Preprocessing for NN on GPU
-
Top 5 Python libraries for Computer vision
Kornia - Kornia is a differentiable computer vision library for PyTorch. It consists of a set of routines and differentiable modules to solve generic computer vision problems. At its core, the package uses PyTorch as its main backend both for efficiency and to take advantage of the reverse-mode auto-differentiation to define and compute the gradient of complex functions.
-
[D] CPU choice for machine learning server (Epyc vs. Threadripper)
Between "not being sure yet" about GPU operations in pre-processing and choosing high-end CPUs, I think you are overthinking the wrong alternative. Besides DALI, check whether you are using codecs besides nvidia/torchvision-supported jpeg and png, and if other GPU CV libraries meet your needs: torchvision kornia
-
[P] Using PyTorch + NumPy? A bug that plagues thousands of open-source ML projects.
Use kornia.augmentation where this problem is solved doing the augmentations in batch outside the dataloader. https://github.com/kornia/kornia
What are some alternatives?
awesome-python-scientific-audio - Curated list of python software and packages related to scientific research in audio
OpenCV - Open Source Computer Vision Library
Face Recognition - The world's simplest facial recognition api for Python and the command line
EasyOCR - Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
SimpleCV - The Open Source Framework for Machine Vision
multi-object-tracker - Multi-object trackers in Python
gaps - A Genetic Algorithm-Based Solver for Jigsaw Puzzles :cyclone:
tesserocr - A Python wrapper for the tesseract-ocr API
pytesseract - A Python wrapper for Google Tesseract
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
duckling - Language, engine, and tooling for expressing, testing, and evaluating composable language rules on input strings.
ivy - The Unified AI Framework