Python finetuning

Open-source Python projects categorized as finetuning

Top 17 Python finetuning Projects

  1. unsloth

    Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train Qwen3, Llama 4, DeepSeek-R1, Gemma 3, TTS 2x faster with 70% less VRAM.

    Project mention: When Fine-Tuning Makes Sense: A Developer's Guide | news.ycombinator.com | 2025-06-01

    Lot's of tools for each of those separately (RAG and fine-tuning). We're working on combining them but it's not ready yet.

    You don't need a big GPU cluster. Fine-tuning is quite accessible via both APIs and local tools. Some suggestions:

    - getkiln.ai (biased, my tool): let's you try all of the below, and compare/eval the resulting models

    - API based tuning for closed models: OpenAI, Google Gemini

    - API based tuning for open models: Together.ai, Fireworks.ai

    - Local tuning for open models: https://unsloth.ai (can be run on Google Collab instances if you don't have local Nvidia GPUs).

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. h2o-llmstudio

    H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

  4. dataherald

    Interact with your SQL database, Natural Language to SQL using LLMs

  5. learn2learn

    A PyTorch Library for Meta-learning Research

  6. xTuring

    Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

  7. LazyLLM

    Easiest and laziest way for building multi-agent LLMs applications.

    Project mention: Universal Personal Assistant with LLMs | dev.to | 2024-12-11

    Specialized projects that facilitate automatic document indexing and LLM invocation with the document content are gaining traction, for example PrivateGPT, QAnything, and LazyLLM. Another novelty is the integration of LLMs into applications and tools: The Semantic Kernel project aims to integrate LLM invocation during programming and inside the code itself.

  8. LLM-Finetuning-Toolkit

    Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  10. godot-dodo

    Finetuning large language models for GDScript generation.

  11. finetune-gpt2xl

    Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

  12. LLMtuner

    FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)

  13. llm-toys

    Small finetuned LLMs for a diverse set of useful tasks

  14. nanoChatGPT

    nanogpt turned into a chat model (by VatsaDev)

  15. praetor-data

    Praetor is a lightweight finetuning data and prompt management tool

  16. midistral

    LLM finetuned for generating symbolic music

    Project mention: LLM finetuned for generating symbolic music | news.ycombinator.com | 2025-01-29
  17. Zicklein

    Finetuning instruct-LLaMA on german datasets.

  18. openpo

    Building synthetic data for preference tuning

    Project mention: Show HN: OpenPO – Human feedback collection made easy for LLM | news.ycombinator.com | 2024-11-18
  19. reddit-finetune-frontend

    A webapp used for finetuning an openai model with data scraped from reddit

  20. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python finetuning discussion

Log in or Post with

Python finetuning related posts

  • Agent with Local, Remote MCP Tools using AWS Strands Agents 🧬 Bedrock, Nova, Fast API, Streamlit

    1 project | dev.to | 18 Jun 2025
  • What is Google Agent Development Kit (ADK)? 🤖 Agent App with Local, Remote MCP Tools 🔧 using ADK, Gemini, Fast API, Streamlit UI

    2 projects | dev.to | 11 Jun 2025
  • Fine-Tune SLMs in Colab for Free : A 4-Bit Approach with Meta Llama 3.2

    1 project | dev.to | 10 May 2025
  • Unsloth Now Supports GRPO

    1 project | news.ycombinator.com | 6 Feb 2025
  • Unsloth: Easily finetune and train LLMs Get faster with unsloth

    1 project | news.ycombinator.com | 6 Nov 2024
  • ThunderKittens: Simple, Fast, and Adorable AI Kernels

    2 projects | news.ycombinator.com | 30 Oct 2024
  • Meta's Open Source NotebookLM

    5 projects | news.ycombinator.com | 27 Oct 2024
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 19 Jun 2025
    InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now. Learn more →

Index

What are some of the best open-source finetuning projects in Python? This list will help you:

# Project Stars
1 unsloth 40,474
2 h2o-llmstudio 4,323
3 dataherald 3,511
4 learn2learn 2,792
5 xTuring 2,653
6 LazyLLM 2,012
7 LLM-Finetuning-Toolkit 844
8 godot-dodo 549
9 finetune-gpt2xl 437
10 LLMtuner 237
11 llm-toys 126
12 nanoChatGPT 68
13 praetor-data 67
14 midistral 41
15 Zicklein 34
16 openpo 27
17 reddit-finetune-frontend 1

Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com

Did you know that Python is
the 2nd most popular programming language
based on number of references?