Top 12 Python finetuning Projects

• unsloth

  15 5,757 9.3 Python

  2-5X faster 80% less memory LLM finetuning

  

Project mention: Ask HN: Most efficient way to fine-tune an LLM in 2024? | news.ycombinator.com | 2024-04-04

Gemma 7b is 2.4x faster than HF + FA2.

Check out https://github.com/unslothai/unsloth for full benchmarks!

• learn2learn

  2 2,536 5.3 Python

  A PyTorch Library for Meta-learning Research

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• xTuring

  31 2,515 8.4 Python

  Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

  

Project mention: I'm developing an open-source AI tool called xTuring, enabling anyone to construct a Language Model with just 5 lines of code. I'd love to hear your thoughts! | /r/machinelearningnews | 2023-09-07

Explore the project on GitHub here.

• finetuner

  36 1,423 5.5 Python

  :dart: Task-oriented embedding tuning for BERT, CLIP, etc.

  

• DB-GPT-Hub

  1 1,023 9.4 Python

  A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL

  

Project mention: Show HN: Improve Text-to-SQL Accuracy with LLM | news.ycombinator.com | 2023-07-10

• LLM-Finetuning-Toolkit

  1 659 9.6 Python

  Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

  

Project mention: Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing | news.ycombinator.com | 2024-04-07

• finetune-gpt2xl

  9 421 0.0 Python

  Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• llm-toys

  2 114 7.2 Python

  Small(7B and below) finetuned LLMs for a diverse set of useful tasks

Project mention: How to fine tune llama2? | /r/LocalLLaMA | 2023-07-27

You can use the train script here https://github.com/kuutsav/llm-toys/blob/main/llm_toys/train.py. The readme contains a sample training command.

• praetor-data

  5 63 6.4 Python

  Praetor is a lightweight finetuning data and prompt management tool

  

• nanoChatGPT

  3 47 9.3 Python

  nanogpt turned into a chat model (by VatsaDev)

Project mention: A full tutorial on turning GPT-2 into a conversational AI | news.ycombinator.com | 2023-08-31

Hi, Vatsa here, this is tutorial on turning GPT-2 into a conversational bot, it was a fun project, and I hope you like it it!

github -> https://github.com/VatsaDev/nanoChatGPT

• Zicklein

  3 32 5.0 Python

  Finetuning instruct-LLaMA on german datasets.

Project mention: Zicklein - a German 🇩🇪 finetuned LlaMA-7b base model (OS) | /r/LocalLLaMA | 2023-05-22

• reddit-finetune-frontend

  1 1 7.1 Python

  A webapp used for finetuning an openai model with data scraped from reddit

Python finetuning related posts

• Ask HN: Most efficient way to fine-tune an LLM in 2024?
  6 projects | news.ycombinator.com | 4 Apr 2024
• AMD ROCm Software Blogs
  4 projects | news.ycombinator.com | 23 Feb 2024
• Show HN: We got fine-tuning Mistral-7B to not suck
  4 projects | news.ycombinator.com | 7 Feb 2024
• Has anyone tried out the ASPEN-Framework for LoRA Fine-Tuning yet and can share their experience?
  2 projects | /r/LocalLLaMA | 6 Dec 2023
• Show HN: 80% faster, 50% less memory, 0% loss of accuracy Llama finetuning
  1 project | /r/hypeurls | 5 Dec 2023
• 80% faster, 50% less memory, 0% loss of accuracy Llama finetuning
  6 projects | news.ycombinator.com | 1 Dec 2023
• Show HN: Unsloth – finetune Llama 2x faster 50% less memory
  1 project | news.ycombinator.com | 30 Nov 2023
• A note from our sponsor - WorkOS
  workos.com | 24 Apr 2024

  The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!