Python Lora

Open-source Python projects categorized as Lora
Edit details
Topics: #stable-diffusion #fine-tuning #Deep Learning #llm #llama
Updating dependencies is time-consuming.
Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free.
blog.mergify.com
Sponsored

Top 20 Python Lora Projects

  • LoRA

    Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

    Project mention: Run LLMs at home, BitTorrent‑style | news.ycombinator.com | 2023-09-17

    Somewhat yes. See "LoRA": https://arxiv.org/abs/2106.09685

    They're not composable in the sense that you can take these adaptation layers and arbitrarily combine them, but training different models while sharing a common base of weights is a solved problem.

  • xTuring

    Easily build, customize and control your own LLMs

    Project mention: I'm developing an open-source AI tool called xTuring, enabling anyone to construct a Language Model with just 5 lines of code. I'd love to hear your thoughts! | /r/machinelearningnews | 2023-09-07

    Explore the project on GitHub here.

  • Mergify

    Updating dependencies is time-consuming.. Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free.

  • Reticulum

    The cryptography-based networking stack for building unstoppable networks with LoRa, Packet Radio, WiFi and everything in between.

    Project mention: Find Alternatives for Ourselves Megathread | /r/RedditAlternatives | 2023-06-09

    Reticulum

  • Lora-for-Diffusers

    The most easy-to-understand tutorial for using LoRA (Low-Rank Adaptation) within diffusers framework for AI Generation Researchers🔥

    Project mention: Question for LoRA pros | /r/StableDiffusion | 2023-04-08

    Check this out: https://github.com/haofanwang/Lora-for-Diffusers I assume you created your .safetensors LoRA model with GUI. You can't directly use safetensors like "pipe.unet.load_attn_procs(model_path) " (at least for now). Just check the link

  • LLaMA-LoRA-Tuner

    UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.

    Project mention: [P] Uptraining a pretrained model using company data? | /r/MachineLearning | 2023-05-25

  • LLM-Finetuning-Hub

    Repository that contains LLM fine-tuning and deployment scripts along with our research findings.

    Project mention: FLaNK Stack Weekly for 12 September 2023 | dev.to | 2023-09-12

  • NomadNet

    Communicate Freely

    Project mention: Reticulum Development Roadmap | /r/reticulum | 2022-11-17

    Related programs such as Sideband and Nomadnet has also had their repositories updated with more visible roadmaps.

  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

  • OneDiffusion

    OneDiffusion: Run any Stable Diffusion models and fine-tuned weights with ease

    Project mention: OneDiffusion | news.ycombinator.com | 2023-08-22

  • kohya-sd-scripts-webui

    Gradio wrapper for sd-scripts by kohya

    Project mention: Captioning Training Images | /r/StableDiffusion | 2023-04-04

    I've never use this but there is Batch Captioning on preparation tab. It can run as standalone program or even Automatic1111's extension.

  • Sideband

    LXMF client for Android, Linux and macOS allowing you to communicate with people or LXMF-compatible systems over Reticulum networks using LoRa, Packet Radio, WiFi, I2P, or anything else Reticulum supports.

    Project mention: Sideband v0.4.0 - with Paper Messaging and better hardware support - has been released | /r/reticulum | 2022-11-24

  • VisionCrafter

    Craft your visions

    Project mention: Fanmade Subreddit for the Github AI Video project VisionCrafter | /r/visioncrafter | 2023-08-09

    git clone https://github.com/diStyApps/VisionCrafter

  • Dreambooth

    Fine-tuning of diffusion models

    Project mention: What's the best current solution for training a LORA model? | /r/StableDiffusion | 2023-02-22

    This is the one I meant https://github.com/brian6091/Dreambooth

  • LoraGW-Setup

    SX1301 Lora Concentrator Raspberry PI based gateway setup

  • Terkin

    Terkin-Datalogger for MicroPython and CPython

  • safetensors_util

    Utility for Safetensors Files

    Project mention: Training for concepts other than styles or a specific person | /r/StableDiffusion | 2023-05-19

    There is also this tool: https://github.com/by321/safetensors_util which can show captions used to train a LoRA. It probably works on mine. You could try it on CIVITAI models to get an idea of other peoples captions.

  • Zicklein

    Finetuning instruct-LLaMA on german datasets.

    Project mention: Zicklein - a German 🇩🇪 finetuned LlaMA-7b base model (OS) | /r/LocalLLaMA | 2023-05-22

  • meshtastic-matrix-relay

    A relay between a Matrix.org room and a Meshtastic radio. This relay extends your Matrix.org-based communication with a LoRa-based Meshtastic radio mesh. This is not an official product of Matrix.org or Meshtastic.

    Project mention: [M<>M Relay] - Meshtastic <-> Matrix Relay! (sharing) | /r/meshtastic | 2023-05-05

    We are excited to share with you our project, a Meshtastic and Matrix relay (M<>M Relay 19), which aims to bridge the gap between the Meshtastic mesh network and the Matrix communication platform.

  • Meshtasticator

    Discrete-event and interactive simulator for Meshtastic.

    Project mention: Pico handheld | /r/cyberDeck | 2023-04-17

    That's unfortunate. However, I found some pretty good resources as a starting point. Sadly I currently do not have access to hardware to test or develop this, but here is a rough description of the protocol and a simulator written in python.

  • llama-peft-tuner

    Tune LLaMa-7B on Alpaca Dataset using PEFT / LORA Based on @zphang's https://github.com/zphang/minimal-llama scripts.

    Project mention: [D] The best way to train an LLM on company data | /r/MachineLearning | 2023-03-29

  • torch-adapters

    Small Library of PyTorch Adaptation modules

    Project mention: Torch parameter efficient fine-tuning library | /r/deeplearning | 2023-06-11

  • Sonar

    Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-09-17.

Python Lora related posts

Index

What are some of the best open-source Lora projects in Python? This list will help you:

Project Stars
1 LoRA 6,581
2 xTuring 2,285
3 Reticulum 1,270
4 Lora-for-Diffusers 562
5 LLaMA-LoRA-Tuner 367
6 LLM-Finetuning-Hub 352
7 NomadNet 315
8 OneDiffusion 244
9 kohya-sd-scripts-webui 158
10 Sideband 140
11 VisionCrafter 111
12 Dreambooth 89
13 LoraGW-Setup 73
14 Terkin 49
15 safetensors_util 32
16 Zicklein 30
17 meshtastic-matrix-relay 28
18 Meshtasticator 26
19 llama-peft-tuner 20
20 torch-adapters 7

Sponsored
Write Clean Python Code. Always.
Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
www.sonarsource.com