Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
Why do you think that https://github.com/yxli2123/LoftQ is a good alternative to relora
Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
Why do you think that https://github.com/yxli2123/LoftQ is a good alternative to relora