Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
Here you can share your experience with the project you are suggesting or its comparison with relora. Optional.
A valid email to send you a verification link when necessary or log in.