torchscale VS extreme-bert

Compare torchscale vs extreme-bert and see what are their differences.

torchscale

Foundation Architecture for (M)LLMs (by microsoft)
Computer Vision Machine Learning multimodal Natural Language Processing pretrained-language-model speech-processing Transformer Translation
Source Code
aka.ms
Suggest alternative
Edit details

extreme-bert

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”. (by extreme-bert)
Machine Learning Natural Language Processing NLP Python Deep Learning Bert language-model language-models Pytorch Transformer
Source Code
extreme-bert.github.io
Suggest alternative
Edit details
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
torchscale extreme-bert
2 2
2,927 283
1.6% 0.0%
7.2 0.0
25 days ago about 1 year ago
Python Python
MIT License Apache License 2.0
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

torchscale

Posts with mentions or reviews of torchscale. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-07-24.

extreme-bert

Posts with mentions or reviews of extreme-bert. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-12-01.

What are some alternatives?

When comparing torchscale and extreme-bert you can also consider the following projects:

towhee - Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

primeqa - The prime repository for state-of-the-art Multilingual Question Answering research and development.

fairscale - PyTorch extensions for high performance and large scale training.

pixel - Research code for pixel-based encoders of language (PIXEL)

bertviz - BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

xformers - Hackable and optimized Transformers building blocks, supporting a composable construction.

RATransformers - RATransformers 🐭- Make your transformer (like BERT, RoBERTa, GPT-2 and T5) Relation Aware!

glami-1m - The largest multilingual image-text classification dataset. It contains fashion products.

transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

transformer-mlm - Implementation of Transformer Encoders / Masked Language Modeling Objective

torchscale vs towhee extreme-bert vs primeqa torchscale vs fairscale extreme-bert vs pixel torchscale vs bertviz extreme-bert vs bertviz torchscale vs xformers extreme-bert vs RATransformers torchscale vs glami-1m extreme-bert vs transformers torchscale vs transformers extreme-bert vs transformer-mlm