St-moe-pytorch Alternatives

Similar projects and alternatives to st-moe-pytorch based on common topics and language

• OpenMoE

  8 1,206 8.6 Python st-moe-pytorch VS OpenMoE

  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models

• spaCy

  106 28,751 9.2 Python st-moe-pytorch VS spaCy

  💫 Industrial-strength Natural Language Processing (NLP) in Python

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• mixture-of-experts

  1 525 4.1 Python st-moe-pytorch VS mixture-of-experts

  A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models (by lucidrains)

• DeepSpeed

  51 32,739 9.8 Python st-moe-pytorch VS DeepSpeed

  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  

• mixtral-offloading

  3 2,235 8.7 Python st-moe-pytorch VS mixtral-offloading

  Run Mixtral-8x7B models in Colab or consumer desktops

• hivemind

  40 1,840 5.4 Python st-moe-pytorch VS hivemind

  Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.