PaLM-flax
soundstorm-pytorch
| PaLM-flax | soundstorm-pytorch | |
|---|---|---|
| 1 | 1 | |
| 14 | 1,455 | |
| - | - | |
| 4.2 | 6.0 | |
| over 2 years ago | 3 months ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
PaLM-flax
-
[R] Proprietary ML model in research paper
Google, Deepmind, and OpenAI normally provide a section in their research papers for replicating the pre-training and fine-tuning architectures of the models. For example, a replication of the pre-training architecture outlined in the LaMDA research paper in PyTorch (https://github.com/conceptofmind/LaMDA-pytorch/blob/main/lamda\_pytorch/lamda\_pytorch.py) or another implementation of Google's SOTA Pathways Language Model in JAX/FLAX (https://github.com/conceptofmind/PaLM-flax).
soundstorm-pytorch
-
Meta introduces Voicebox: state-of-the-art generative AI model for speech
got a response here https://github.com/lucidrains/soundstorm-pytorch/discussions...
What are some alternatives?
PaLM-pytorch - Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
audio-diffusion-pytorch - Audio generation using diffusion models, in PyTorch.
DALLE-pytorch - Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
voicebox - Reskinning the pink trombone tract synth
x-transformers - A concise but complete full-attention transformer with a set of promising experimental features from various papers
slot-attention - Implementation of Slot Attention from GoogleAI
RWKV-LM - RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
Meta-voicebox - Implementation of Meta-Voicebox : The first generative AI model for speech to generalize across tasks with state-of-the-art performance.
whisper-timestamped - Multilingual Automatic Speech Recognition with word-level timestamps and confidence
tortoise-tts-fast - Fast TorToiSe inference (5x or your money back!)
word2wave - Word2Wave: a framework for generating short audio samples from a text prompt using WaveGAN and COALA.
flamingo-pytorch - Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch