makeMoE

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :) (by AviSoori1x)

makeMoE Alternatives

Similar projects and alternatives to makeMoE

  1. llama

    190 makeMoE VS llama

    Inference code for Llama models

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  3. FLiPStackWeekly

    FLaNK AI Weekly covering Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Ozone, Apache Pulsar, and more...

  4. autogen

    72 makeMoE VS autogen

    A programming framework for agentic AI

  5. spring-ai

    An Application Framework for AI Engineering

  6. mergekit

    6 makeMoE VS mergekit

    Tools for merging pretrained large language models.

  7. deeplake

    Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

  8. garnet

    Garnet is a remote cache-store from Microsoft Research that offers strong performance (throughput and latency), scalability, storage, recovery, cluster sharding, key migration, and replication features. Garnet can work with existing Redis clients.

  9. mixtral-offloading

    Run Mixtral-8x7B models in Colab or consumer desktops

  10. dbrx

    4 makeMoE VS dbrx

    Discontinued Code examples and resources for DBRX, a large language model developed by Databricks [GET https://api.github.com/repos/databricks/dbrx: 404 - Not Found // See: https://docs.github.com/rest/repos/repos#get-a-repository]

  11. TextSnatcher

    How to Copy Text from Images ? Answer is TextSnatcher !. Perform OCR operations in seconds on Linux Desktop.

  12. pretzelai

    9 makeMoE VS pretzelai

    The modern replacement for Jupyter Notebooks

  13. LLMLingua

    8 makeMoE VS LLMLingua

    [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

  14. incubator-xtable

    Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.

  15. auto-dev

    4 makeMoE VS auto-dev

    🧙‍AutoDev: the AI-native Multi-Agent development platform built on Kotlin Multiplatform, covering all 7 phases of SDLC.

  16. LaVague

    5 makeMoE VS LaVague

    Large Action Model framework to develop AI Web Agents

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better makeMoE alternative or higher similarity.

makeMoE discussion

Log in or Post with

makeMoE reviews and mentions

Posts with mentions or reviews of makeMoE. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-03-27.

Stats

Basic makeMoE repo stats
3
811
8.0
almost 2 years ago

AviSoori1x/makeMoE is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of makeMoE is Jupyter Notebook.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com