Our great sponsors
-
TextAttack
TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/
-
pytorch-lightning
Discontinued Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning] (by PyTorchLightning)
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
Text data augmentation - negate words, replace words with similes, perturb word embeddings (nice github repo for this)
Lower precision training can help and on pytorch lightning is just a simple flag you can set
Related posts
- How to finetune a LoRA with Data parallelism?
- Doubt about numpy's eigen calculation
- Make a PyTorch model tensor-parallel in one line of code
- [P] Releasing customized language model pre-training acceleration toolkit: ExtremeBERT
- [P] How Forte Transforms the Building of ML Solutions with PyTorch into Assembly Lines