Python qlora

Open-source Python projects categorized as qlora
Edit details
Topics: llm Lora fine-tuning NLP large-language-models
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 5 Python qlora Projects

  • LLaMA-Factory

    Unify Efficient Fine-Tuning of 100+ LLMs

    • Project mention: FLaNK-AIM Weekly 06 May 2024 | dev.to | 2024-05-06

  • LLM-Finetuning-Toolkit

    Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

    • Project mention: Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing | news.ycombinator.com | 2024-04-07

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • llm-toys

    Small(7B and below) finetuned LLMs for a diverse set of useful tasks

    • Project mention: How to fine tune llama2? | /r/LocalLLaMA | 2023-07-27

    You can use the train script here https://github.com/kuutsav/llm-toys/blob/main/llm_toys/train.py. The readme contains a sample training command.

  • lightning-mlflow-hf

    Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow

    • Project mention: Show HN: LoRA Tune LLM in Lightning on GPU | news.ycombinator.com | 2023-11-12

  • QLoRA-LLM

    A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely decoupled from Hugging Face.

    • Project mention: LoRA from Scratch implementation for LLM finetuning | news.ycombinator.com | 2024-01-22

    If anyone is interested in a more 'pure' or 'scratch' implementation, check out https://github.com/michaelnny/QLoRA-LLM. (author here) It also supports 4-bit quantized LoRA, using only PyTorch and bitsandbytes, without any other tools.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python qlora related posts

  • How to fine tune llama2?

    2 projects | /r/LocalLLaMA | 27 Jul 2023

Index

What are some of the best open-source qlora projects in Python? This list will help you:

Project Stars
1 LLaMA-Factory 21,791
2 LLM-Finetuning-Toolkit 676
3 llm-toys 115
4 lightning-mlflow-hf 45
5 QLoRA-LLM 2

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com