SaaSHub helps you find the best software and product alternatives Learn more →
LoRA-EXTRACTOR Alternatives
Similar projects and alternatives to LoRA-EXTRACTOR
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
LoRA-EXTRACTOR-Colab
A small script to extract LoRA models from custom checkpoints, in Google Colab.
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better LoRA-EXTRACTOR alternative or higher similarity.
LoRA-EXTRACTOR reviews and mentions
Posts with mentions or reviews of LoRA-EXTRACTOR.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-03-03.
-
The duality of this subreddit
Regardless of the method used to fine tune the model it wouldn't exceed the sizes I listed above. (fun fact, the maximum dimensions for LoRA is 320 (which limits the LoRA models to ~500mb, because that is the size of the smallest tensor) https://github.com/sashaok123/LoRA-EXTRACTOR/issues/8 (with LoCons it might be slightly larger, but I have not check out the theoretical limit of LoCons yet)
-
LORA Extraction from Custom Models in Google Colab
I changed sashaok123's code to work on Google Colab. https://github.com/AlirezaF80/LoRA-EXTRACTOR-Colab
-
Lora extractions VS. DB model - Can we truly replace 2/4gb models with 300mb Loras for the same results?
Can you extract a "LoRA transform" by comparing the weights from 2 checkpoints? Yes you can. https://github.com/sashaok123/LoRA-EXTRACTOR/blob/main/lib/extract_lora_from_models.py is a script that does exactly that, and if you look at the code, all it is is just applying singular value decomposition (SVD) (the underlying method behind principal component analysis (PCA), for those who are more Statistics/ML minded) to calculate the transformation between the two. Will you lose information when you "compress" the network using SVD? yes, the amount of "information" (in stats this is measured by variance) explained by the "lower ranked" component omitted by the new compressed representation, however the more similar the networks are, the less components will be needed to represent the differences.
-
Automatic1111 Webui Help: Dreambooth + DeepSpeed LoRA Training on 8GB VRAM
Instead of using kohya_ss, I used https://github.com/sashaok123/LoRA-EXTRACTOR
- LORA extractor tool
-
Can someone request AUTO1111 to include LORA-extraction script by sashaok123?
Here is the link to the LORA-extraction script on github by sashaok123: https://github.com/sashaok123/LoRA-EXTRACTOR
-
Created a tiny script for more convenient extraction of LoRA models
Link to GitHub, where you can download the script.
-
A note from our sponsor - SaaSHub
www.saashub.com | 26 Apr 2024
Stats
Basic LoRA-EXTRACTOR repo stats
8
73
10.0
about 1 year ago
The primary programming language of LoRA-EXTRACTOR is Python.
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com