Tutel Alternatives

Similar projects and alternatives to tutel based on common topics and language

• hivemind

  40 1,833 5.9 Python tutel VS hivemind

  Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

  

• mixture-of-experts

  2 818 5.3 Python tutel VS mixture-of-experts

  PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• transformers

  175 124,557 10.0 Python tutel VS transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  

• ModuleFormer

  1 215 5.7 Python tutel VS ModuleFormer

  ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward experts. We released a collection of ModuleFormer-based Language Models (MoLM) ranging in scale from 4 billion to 8 billion parameters.

  

• best-of-ml-python

  16 15,302 7.9 Python tutel VS best-of-ml-python

  🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.