makeMoE
FLaNK-python-processors
makeMoE | FLaNK-python-processors | |
---|---|---|
3 | 16 | |
538 | 4 | |
- | - | |
9.0 | 7.1 | |
2 months ago | 2 months ago | |
Jupyter Notebook | Python | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
makeMoE
-
DBRX: A New Open LLM
This repo I created and the linked blog will help in understanding this: https://github.com/AviSoori1x/makeMoE
- FLaNK AI Weekly 25 March 2025
- Implementation of mixture of experts language model in a single file of PyTorch
FLaNK-python-processors
What are some alternatives?
mergekit - Tools for merging pretrained large language models.
tracecat - The open source Tines alternative. Automate security workflows at scale with code and no-code.
spring-ai - An Application Framework for AI Engineering
grok-1 - Grok open release
FeatUp - Official code for "FeatUp: A Model-Agnostic Frameworkfor Features at Any Resolution" ICLR 2024
lapdev - Self-Hosted Remote Dev Environment
examples - This repository will contain examples of use cases that utilize Decodable streaming solution
dbrx - Code examples and resources for DBRX, a large language model developed by Databricks
CML_AMP-to-Airgapped - Download the AMP catalog for an offline (airgapped) deployment of the AMP catalog.
DataDreamer - DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
FastChat - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.