Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint
Why do you think that https://github.com/mzguntalan/h-former is a good alternative to GradCache
Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint
Why do you think that https://github.com/mzguntalan/h-former is a good alternative to GradCache