cramming VS extreme-bert

Compare cramming vs extreme-bert and see what are their differences.

cramming

Cramming the training of a (BERT-type) language model into limited compute. (by JonasGeiping)
english-language language-model Machine Learning
Source Code
Suggest alternative
Edit details

extreme-bert

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”. (by extreme-bert)
Machine Learning Natural Language Processing NLP Python Deep Learning Bert language-model language-models Pytorch Transformer
Source Code
extreme-bert.github.io
Suggest alternative
Edit details
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
cramming extreme-bert
6 2
1,238 283
- 0.0%
7.3 0.0
16 days ago about 1 year ago
Python Python
MIT License Apache License 2.0
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

cramming

Posts with mentions or reviews of cramming. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-06-03.

extreme-bert

Posts with mentions or reviews of extreme-bert. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-12-01.

What are some alternatives?

When comparing cramming and extreme-bert you can also consider the following projects:

nanoGPT - The simplest, fastest repository for training/finetuning medium-sized GPTs.

torchscale - Foundation Architecture for (M)LLMs

askai - Command Line Interface for OpenAi ChatGPT

primeqa - The prime repository for state-of-the-art Multilingual Question Answering research and development.

english-lang - The English Programming Language

pixel - Research code for pixel-based encoders of language (PIXEL)

aitextgen - A robust Python tool for text-based AI training and generation using GPT-2.

bertviz - BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

flan-ul2-alpaca

RATransformers - RATransformers 🐭- Make your transformer (like BERT, RoBERTa, GPT-2 and T5) Relation Aware!

askai - Your simple terminal helper - A CLI integration with OpenAI's GPT3

transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

cramming vs nanoGPT extreme-bert vs torchscale cramming vs askai extreme-bert vs primeqa cramming vs english-lang extreme-bert vs pixel cramming vs aitextgen extreme-bert vs bertviz cramming vs flan-ul2-alpaca extreme-bert vs RATransformers cramming vs askai extreme-bert vs transformers