SpecVQGAN
MoViNet-pytorch
| SpecVQGAN | MoViNet-pytorch | |
|---|---|---|
| 2 | 1 | |
| 318 | 234 | |
| - | - | |
| 2.2 | 0.0 | |
| 11 months ago | almost 2 years ago | |
| Jupyter Notebook | Jupyter Notebook | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
SpecVQGAN
-
Text-to-Audio Generation Using Instruction Tuned LLM and Latent Diffusion Model
Excellent. Some of the theory here goes back to Oct/2021 and beyond [1].
The riffusion.com [2] guys made this practical. Also, my video of high-level overview and examples [3].
1. SpecVQGAN: https://github.com/v-iashin/SpecVQGAN
2. Riffusion: ://www.riffusion.com/
3. Riffusion high-level overview: https://youtu.be/olkLVGcvib8
- "Taming Visually Guided Sound Generation". Quickly generate audio matching a given video. Code includes a Google Colab.
MoViNet-pytorch
-
[P] MoViNet in PyTorch
TL;DR: Implemented MoViNet in PyTorch: https://github.com/Atze00/MoViNet-pytorch
What are some alternatives?
poolformer - PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
Video-Swin-Transformer - This is an official implementation for "Video Swin Transformers".
vid2cleantxt - Python API & command-line tool to easily transcribe speech-based video files into clean text
autovideo - AutoVideo: An Automated Video Action Recognition System
ru-dalle - Generate images from texts. In Russian
Anime4K - A High-Quality Real Time Upscaler for Anime Video
awesome-python-applications - 💿 Free software that works great, and also happens to be open-source Python.
BMT - Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)
WOLOF-ASR-Wav2Vec2 - Audio Preprocessing and finetuning of wav2vec2-large-xlsr model on AI4D Baamtu Datamation - Automatic Speech Recognition in WOLOF Data.
nn - 🧑🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠