Model parallel transformers in JAX and Haiku
Why do you think that https://github.com/EleutherAI/the-pile is a good alternative to mesh-transformer-jax
Model parallel transformers in JAX and Haiku
Why do you think that https://github.com/EleutherAI/the-pile is a good alternative to mesh-transformer-jax