Model parallel transformers in JAX and Haiku
Why do you think that https://github.com/yandex/YaLM-100B is a good alternative to mesh-transformer-jax
Model parallel transformers in JAX and Haiku
Why do you think that https://github.com/yandex/YaLM-100B is a good alternative to mesh-transformer-jax