mixture-of-experts

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models (by lucidrains)

Mixture-of-experts Alternatives

Similar projects and alternatives to mixture-of-experts based on common topics and language

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better mixture-of-experts alternative or higher similarity.

mixture-of-experts reviews and mentions

Posts with mentions or reviews of mixture-of-experts. We have used some of these posts to build our list of alternatives and similar projects.

Stats

Basic mixture-of-experts repo stats
1
517
4.1
7 months ago

lucidrains/mixture-of-experts is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of mixture-of-experts is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com