SaaSHub helps you find the best software and product alternatives Learn more →
Qlora Alternatives
Similar projects and alternatives to qlora
-
textgen
Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
openpilot
openpilot is an operating system for robotics. Currently, it upgrades the driver assistance system on 300+ supported cars.
-
system-design-primer
Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.
-
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
-
private-gpt
Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference server.
-
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
-
-
FLiPStackWeekly
FLaNK AI Weekly covering Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Ozone, Apache Pulsar, and more...
-
wirehole
WireHole is a combination of WireGuard, Pi-hole, and Unbound in a docker-compose project with the intent of enabling users to quickly and easily create a personally managed full or split-tunnel WireGuard VPN with ad blocking capabilities thanks to Pi-hole, and DNS caching, additional privacy options, and upstream providers via Unbound.
-
-
delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs (by delta-io)
-
-
-
-
-
-
-
-
qlora discussion
qlora reviews and mentions
-
LLM Fine-Tuning vs RAG: A Production Decision Framework for Engineering Teams
QLoRA (Dettmers et al., 2023) adds 4-bit NormalFloat quantization to the frozen base model, reducing memory further. A 7B model that requires ~14GB in 16-bit precision requires ~5GB in 4-bit QLoRA. This fits on a single consumer GPU (RTX 3090, RTX 4090).
-
AI Experts Are Dead. Long Live the AI Experts.
Dettmers et al. (2023), QLoRA: Efficient Finetuning of Quantized LLMs. Combines 4-bit quantisation with LoRA.
-
TorchLean: Formalizing Neural Networks in Lean
- QLoRA: Efficient Finetuning of Quantized LLMs https://arxiv.org/abs/2305.14314
- Can You Self-Host an Efficient AI at Home or for your Company?
-
Run Big LLMs on Small GPUs: A Hands-On Guide to 4-bit Quantization and QLoRA
artidoro/qlora: https://github.com/artidoro/qlora
-
Fine-Tuning LLMs: A Review of Technologies, Research, Best Practices, Challenges
I took a skim through it in the morning - I like the LoRA Learns Less and Forgets Less paper more https://openreview.net/forum?id=aloEru2qCG - it has much more signal in a few pages - also the original QLoRA paper from Dettmers https://arxiv.org/abs/2305.14314 has so many more important morsels.
But all in all, the review is a reasonable "manual" I guess. I would have liked maybe more instructive comprehensive practical examples, and maybe more mention of other OSS packages for finetuning :))
- FLaNK Stack Weekly for 30 Oct 2023
-
I released Marx 3B V3.
Marx 3B V3 is StableLM 3B 4E1T instruction tuned on EverythingLM Data V3(ShareGPT Format) for 2 epochs using QLoRA.
-
Tuning and Testing Llama 2, Flan-T5, and GPT-J with LoRA, Sematic, and Gradio
https://github.com/artidoro/qlora
The tools and mechanisms to get a model to do what you want is ever so changing, ever so quickly. Build and understand a notebook yourself, and reduce dependencies. You will need to switch them.
-
Yet another QLoRA tutorial
My own project right now is still in raw generated form, and this now makes me think about trying qlora's scripts since this gives me some confidence I should be able to get it to turn out now that someone else has carved a path and charted the map. I was going to target llamatune which was mentioned here the other day.
-
A note from our sponsor - SaaSHub
www.saashub.com | 11 Jul 2026
Stats
artidoro/qlora is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of qlora is Jupyter Notebook.