soundstorm-pytorch
parti-pytorch
| soundstorm-pytorch | parti-pytorch | |
|---|---|---|
| 1 | 2 | |
| 1,122 | 506 | |
| - | - | |
| 7.3 | 5.5 | |
| 12 days ago | 5 months ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
soundstorm-pytorch
-
Meta introduces Voicebox: state-of-the-art generative AI model for speech
got a response here https://github.com/lucidrains/soundstorm-pytorch/discussions...
parti-pytorch
- Google Parti open source implementation
-
Pathways Autoregressive Text-to-Image Model (Parti)
Give it a few days and lucidrains will have the code up[0].
But in honesty, it is probably how people react. We saw this with Pulse, GPT, and many others. The authors are clear about the limitations but people talk it up too much and others shit on it. There's also a reproducibility crisis in ML (many famous networks, like Swin[1][2][3], can't be reproduced (even worse when reviewers concentrate on benchmarks)). It isn't like many can train a model like this anyways. It gives them benefit of the doubt and maintains good publicity rather than controversial.
Of course, this is extremely bad from an academic perspective and personally I believe you should have your paper revoked if it isn't reproducible. You'd be surprised how many don't track the random seed or measure variance. We have GitHub. You should be able to write training options that get approximately the same results as the paper. Otherwise I don't trust your results.
[0] https://github.com/lucidrains/parti-pytorch
[1] https://github.com/microsoft/Swin-Transformer/issues/183
[2] https://github.com/microsoft/Swin-Transformer/issues/180
[3] https://github.com/microsoft/Swin-Transformer/issues/148
What are some alternatives?
audio-diffusion-pytorch - Audio generation using diffusion models, in PyTorch.
Swin-Transformer - This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".
slot-attention - Implementation of Slot Attention from GoogleAI
DALLE-pytorch - Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
tortoise-tts-fast - Fast TorToiSe inference (5x or your money back!)
muse-maskgit-pytorch - Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch
voicebox - Reskinning the pink trombone tract synth
deep-daze - Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
word2wave - Word2Wave: a framework for generating short audio samples from a text prompt using WaveGAN and COALA.
performer-pytorch - An implementation of Performer, a linear attention-based transformer, in Pytorch
deep-implicit-attention - Implementation of deep implicit attention in PyTorch
x-transformers - A simple but complete full-attention transformer with a set of promising experimental features from various papers