PaLM-pytorch
nuwa-pytorch
| PaLM-pytorch | nuwa-pytorch | |
|---|---|---|
| 3 | 1 | |
| 821 | 540 | |
| - | - | |
| 0.0 | 0.0 | |
| about 2 years ago | almost 2 years ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
PaLM-pytorch
-
Implementing the Gargantuan Pathways with Colossal-AI, easy and efficient!
We firstly reproduced the PaLM model architecture on one GPU according to the PaLM paper’s description. Here we have referred following repo for the reproduction: https://github.com/lucidrains/PaLM-pytorch
- [R] Google's 540B (Dense) model Pathways LLM, "Unlocks" new tasks proportional to scale
- Pathways Language Model (Palm): 540B Parameters for Breakthrough Perf
nuwa-pytorch
What are some alternatives?
CoCa-pytorch - Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch
DALLE2-video - Direct application of DALLE-2 to video synthesis, using factored space-time Unet and Transformers
DALLE-pytorch - Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
ai-text-to-audio-latent-diffusion - text-to-audio-latent-diffusion
PaLM-colossalai - Scalable PaLM implementation of PyTorch
tango - A family of diffusion models for text-to-audio generation.
x-transformers - A concise but complete full-attention transformer with a set of promising experimental features from various papers
word2wave - Word2Wave: a framework for generating short audio samples from a text prompt using WaveGAN and COALA.
PaLM-flax - Implementation of the SOTA Transformer architecture from PaLM - Scaling Language Modeling with Pathways in JAX/Flax
phenaki-pytorch - Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch
ez-text2video - Easily run text-to-video diffusion with customized video length, fps, and dimensions on 4GB video cards or on CPU.
flamingo-pytorch - Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch