Torchscale Alternatives
Similar projects and alternatives to torchscale
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
towhee
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
-
extreme-bert
ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.
-
RetNet
An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
torchscale reviews and mentions
-
Retentive Network: A Successor to Transformer Implemented in PyTorch
A retnet commit has now appeared in Microsoft's torchscale repo:
https://github.com/microsoft/torchscale/commit/bf65397b26469...
- [R] TorchScale: Transformers at Scale - Microsoft 2022 Shuming Ma et al - Improves modeling generality and capability, as well as training stability and efficiency.
Stats
microsoft/torchscale is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of torchscale is Python.
Popular Comparisons
Sponsored