Tutel MoE: An Optimized Mixture-of-Experts Implementation
Why do you think that https://github.com/learning-at-home/hivemind is a good alternative to tutel
Tutel MoE: An Optimized Mixture-of-Experts Implementation
Why do you think that https://github.com/learning-at-home/hivemind is a good alternative to tutel