Temporary remove unused tokens during training to save ram and speed.
Why do you think that https://github.com/huggingface/peft is a good alternative to transformer-smaller-training-vocab
Temporary remove unused tokens during training to save ram and speed.
Why do you think that https://github.com/huggingface/peft is a good alternative to transformer-smaller-training-vocab