modular-diffusion
extreme-bert
| modular-diffusion | extreme-bert | |
|---|---|---|
| 1 | 2 | |
| 257 | 283 | |
| - | 0.0% | |
| 8.0 | 0.0 | |
| 7 months ago | about 1 year ago | |
| Python | Python | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
modular-diffusion
-
I Built a Modular Python Library for Designing and Training Diffusion Models from Scratch
Last week, I released a project I've been working on for months: Modular Diffusion. It's a modular Python library for designing and training your own Diffusion Models in just a few lines of code. I also wrote a documentation page. The project has already gotten some great community feedback and I'm hoping you guys like it too!
extreme-bert
-
[P] Releasing customized language model pre-training acceleration toolkit: ExtremeBERT
Found relevant code at https://github.com/extreme-bert/extreme-bert + all code implementations here
What are some alternatives?
minimal-text-diffusion - A minimal implementation of diffusion models for text generation
torchscale - Foundation Architecture for (M)LLMs
GODEL - Large-scale pretrained models for goal-directed dialog
primeqa - The prime repository for state-of-the-art Multilingual Question Answering research and development.
pixel - Research code for pixel-based encoders of language (PIXEL)
bertviz - BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
RATransformers - RATransformers 🐭- Make your transformer (like BERT, RoBERTa, GPT-2 and T5) Relation Aware!
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
transformer-mlm - Implementation of Transformer Encoders / Masked Language Modeling Objective
code-representations-ml-brain - [NeurIPS 2022] "Convergent Representations of Computer Programs in Human and Artificial Neural Networks" by Shashank Srikant*, Benjamin Lipkin*, Anna A. Ivanova, Evelina Fedorenko, Una-May O'Reilly.
AliceMind - ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab
haystack - :mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.