LoftQ Alternatives
Similar projects and alternatives to LoftQ
-
relora
Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better LoftQ alternative or higher similarity.
LoftQ reviews and mentions
Posts with mentions or reviews of LoftQ.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-09.
-
Aurelian: 70B 32K story-writing (and more) [Alpha]
But the quantization is done before training, and may not be optimal as you train the model. LoftQ is a method to re-compute the quantizations, taking into account the current full model (base model + learned LORA).
- New LoftQ quantization technique outperforms QLora
Stats
Basic LoftQ repo stats
2
161
8.5
8 days ago
yxli2123/LoftQ is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of LoftQ is Python.
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com