Python finetuning

Open-source Python projects categorized as finetuning

Top 14 Python finetuning Projects

  • unsloth

    Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

  • Project mention: Ask HN: Most efficient way to fine-tune an LLM in 2024? | news.ycombinator.com | 2024-04-04

    Gemma 7b is 2.4x faster than HF + FA2.

    Check out https://github.com/unslothai/unsloth for full benchmarks!

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
  • h2o-llmstudio

    H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/

  • learn2learn

    A PyTorch Library for Meta-learning Research

  • xTuring

    Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

  • Project mention: I'm developing an open-source AI tool called xTuring, enabling anyone to construct a Language Model with just 5 lines of code. I'd love to hear your thoughts! | /r/machinelearningnews | 2023-09-07

    Explore the project on GitHub here.

  • finetuner

    :dart: Task-oriented embedding tuning for BERT, CLIP, etc.

  • DB-GPT-Hub

    A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL

  • Project mention: Show HN: Improve Text-to-SQL Accuracy with LLM | news.ycombinator.com | 2023-07-10
  • LLM-Finetuning-Toolkit

    Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

  • Project mention: Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing | news.ycombinator.com | 2024-04-07
  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • godot-dodo

    Finetuning large language models for GDScript generation.

  • Project mention: Meta: Code Llama, an AI Tool for Coding | news.ycombinator.com | 2023-08-24

    If you can find a large body of good, permissively licensed example code, you can finetune an LLM on it!

    There was a similar attempt for Godot script trained a few months ago, and its reportedly pretty good:

    https://github.com/minosvasilias/godot-dodo

    I think more attempts havent been made because base llama is not that great at coding in general, relative to its other strengths, and stuff like Starcoder has flown under the radar.

  • finetune-gpt2xl

    Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

  • llm-toys

    Small(7B and below) finetuned LLMs for a diverse set of useful tasks

  • Project mention: How to fine tune llama2? | /r/LocalLLaMA | 2023-07-27

    You can use the train script here https://github.com/kuutsav/llm-toys/blob/main/llm_toys/train.py. The readme contains a sample training command.

  • praetor-data

    Praetor is a lightweight finetuning data and prompt management tool

  • nanoChatGPT

    nanogpt turned into a chat model (by VatsaDev)

  • Project mention: A full tutorial on turning GPT-2 into a conversational AI | news.ycombinator.com | 2023-08-31

    Hi, Vatsa here, this is tutorial on turning GPT-2 into a conversational bot, it was a fun project, and I hope you like it it!

    github -> https://github.com/VatsaDev/nanoChatGPT

  • Zicklein

    Finetuning instruct-LLaMA on german datasets.

  • reddit-finetune-frontend

    A webapp used for finetuning an openai model with data scraped from reddit

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python finetuning discussion

Log in or Post with

Python finetuning related posts

  • Ask HN: Most efficient way to fine-tune an LLM in 2024?

    6 projects | news.ycombinator.com | 4 Apr 2024
  • AMD ROCm Software Blogs

    4 projects | news.ycombinator.com | 23 Feb 2024
  • Show HN: We got fine-tuning Mistral-7B to not suck

    4 projects | news.ycombinator.com | 7 Feb 2024
  • Has anyone tried out the ASPEN-Framework for LoRA Fine-Tuning yet and can share their experience?

    2 projects | /r/LocalLLaMA | 6 Dec 2023
  • Show HN: 80% faster, 50% less memory, 0% loss of accuracy Llama finetuning

    1 project | /r/hypeurls | 5 Dec 2023
  • 80% faster, 50% less memory, 0% loss of accuracy Llama finetuning

    6 projects | news.ycombinator.com | 1 Dec 2023
  • Show HN: Unsloth – finetune Llama 2x faster 50% less memory

    1 project | news.ycombinator.com | 30 Nov 2023
  • A note from our sponsor - SaaSHub
    www.saashub.com | 20 Jun 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source finetuning projects in Python? This list will help you:

Project Stars
1 unsloth 11,743
2 h2o-llmstudio 3,722
3 learn2learn 2,569
4 xTuring 2,545
5 finetuner 1,443
6 DB-GPT-Hub 1,152
7 LLM-Finetuning-Toolkit 714
8 godot-dodo 510
9 finetune-gpt2xl 423
10 llm-toys 116
11 praetor-data 63
12 nanoChatGPT 50
13 Zicklein 33
14 reddit-finetune-frontend 1

Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com