Model parallel transformers in JAX and Haiku
Why do you think that https://github.com/NVIDIA/Megatron-LM is a good alternative to mesh-transformer-jax
Model parallel transformers in JAX and Haiku
Why do you think that https://github.com/NVIDIA/Megatron-LM is a good alternative to mesh-transformer-jax