Python fine-tuning

Open-source Python projects categorized as fine-tuning
Edit details
Topics: #Lora #Pytorch #Python #NLP #Classification
Tired of breaking your main and manually rebasing outdated pull requests?
Managing outdated pull requests is time-consuming. Mergify's Merge Queue automates your pull request management & merging. It's fully integrated to GitHub & coordinated with any CI. Start focusing on code. Try Mergify for free.
blog.mergify.com
Sponsored

Top 14 Python fine-tuning Projects

  • xTuring

    Easily build, customize and control your own LLMs

    Project mention: I'm developing an open-source AI tool called xTuring, enabling anyone to construct a Language Model with just 5 lines of code. I'd love to hear your thoughts! | /r/machinelearningnews | 2023-09-07

    Explore the project on GitHub here.

  • custom-diffusion

    Custom Diffusion: Multi-Concept Customization of Text-to-Image Diffusion (CVPR 2023)

    Project mention: ELITE: new fine-tuning technique that can be trained in less than a second | /r/StableDiffusion | 2023-03-08

    I think https://github.com/adobe-research/custom-diffusion

  • Sonar

    Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  • finetuner

    :dart: Task-oriented finetuning for better embeddings on neural search

    Project mention: How do you think search will change with technology like ChatGPT, Bing’s new AI search engine and the upcoming Google Bard? | /r/singularity | 2023-02-21

    And all of that has something to do with finetuners. It basically fine-tunes AI models for specific use cases. With it can create a custom search experience that is tailored to their specific needs. I also wonder how this is going to be integrated into SEO tools soon since those tools are catered to traditional search engines.

  • TencentPretrain

    Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

    Project mention: Fine-tuning Llama | /r/Oobabooga | 2023-03-13

  • LLM-Adapters

    LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models

    Project mention: Google DeepMind CEO Says Some Form of AGI Possible in a Few Years | /r/singularity | 2023-05-03

    That is not true, you can for example use an additional adapter to optimize, that takes 50$ and a 1 hour. https://github.com/AGI-Edgerunners/LLM-Adapters

  • Lora-for-Diffusers

    The most easy-to-understand tutorial for using LoRA (Low-Rank Adaptation) within diffusers framework for AI Generation Researchers🔥

    Project mention: Question for LoRA pros | /r/StableDiffusion | 2023-04-08

    Check this out: https://github.com/haofanwang/Lora-for-Diffusers I assume you created your .safetensors LoRA model with GUI. You can't directly use safetensors like "pipe.unet.load_attn_procs(model_path) " (at least for now). Just check the link

  • simpleT5

    simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.

  • Mergify

    Tired of breaking your main and manually rebasing outdated pull requests?. Managing outdated pull requests is time-consuming. Mergify's Merge Queue automates your pull request management & merging. It's fully integrated to GitHub & coordinated with any CI. Start focusing on code. Try Mergify for free.

  • LLM-Finetuning-Hub

    Repository that contains LLM fine-tuning and deployment scripts along with our research findings.

    Project mention: FLaNK Stack Weekly for 12 September 2023 | dev.to | 2023-09-12

  • OneDiffusion

    OneDiffusion: Run any Stable Diffusion models and fine-tuned weights with ease

    Project mention: OneDiffusion | news.ycombinator.com | 2023-08-22

  • kiri

    Backprop makes it simple to use, finetune, and deploy state-of-the-art ML models. (by kiri-ai)

  • fondant

    Sweet data-centric foundation model fine-tuning

    Project mention: [P] AI image generation without copyright infringement | /r/MachineLearning | 2023-06-29

    We are currently scaling up our solution using Fondant (https://github.com/ml6team/fondant) and will open-source both the pipeline and resulting dataset in the near future.

  • Dreambooth

    Fine-tuning of diffusion models

    Project mention: What's the best current solution for training a LORA model? | /r/StableDiffusion | 2023-02-22

    This is the one I meant https://github.com/brian6091/Dreambooth

  • discus

    Generate and enrich datasets on-demand by leveraging LLMs. Discord: https://discord.gg/t6ADqBKrdZ

    Project mention: an open source package helping developers generate data for LLMs | /r/mlops | 2023-08-02

  • Neural-Scam-Artist

    Web Scraping, Document Deduplication & GPT-2 Fine-tuning with a newly created scam dataset.

  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-09-12.

Python fine-tuning related posts

Index

What are some of the best open-source fine-tuning projects in Python? This list will help you:

Project Stars
1 xTuring 2,272
2 custom-diffusion 1,563
3 finetuner 1,187
4 TencentPretrain 858
5 LLM-Adapters 726
6 Lora-for-Diffusers 556
7 simpleT5 345
8 LLM-Finetuning-Hub 329
9 OneDiffusion 241
10 kiri 240
11 fondant 201
12 Dreambooth 89
13 discus 55
14 Neural-Scam-Artist 21

Sponsored
Collect and Analyze Billions of Data Points in Real Time
Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
www.influxdata.com