Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 23 Python fine-tuning Projects
-
-
Scout Monitoring
Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
-
-
h2o-llmstudio
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/
-
xTuring
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
-
-
custom-diffusion
Custom Diffusion: Multi-Concept Customization of Text-to-Image Diffusion (CVPR 2023)
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
-
-
LLM-Adapters
Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
-
Lora-for-Diffusers
The most easy-to-understand tutorial for using LoRA (Low-Rank Adaptation) within diffusers framework for AI Generation Researchers🔥
-
-
-
simpleT5
simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.
-
-
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing | news.ycombinator.com | 2024-04-07This is a great project, little bit similar to https://github.com/ludwig-ai/ludwig, but it includes testing capabilities and ablation.
questions regarding the LLM testing aspect: How extensive is the test coverage for LLM use cases, and what is the current state of this project area? Do you offer any guarantees, or is it considered an open-ended problem?
Would love to see more progress toward this area!
Project mention: I'm developing an open-source AI tool called xTuring, enabling anyone to construct a Language Model with just 5 lines of code. I'd love to hear your thoughts! | /r/machinelearningnews | 2023-09-07Explore the project on GitHub here.
Project mention: YiVal——Unlocking Your Data's Power to Create Customized GenAI Apps | /r/u_YiVal | 2023-11-16- 🤖Github:https://github.com/YiVal/YiVal/pull/189
Project mention: Now You Can Full Fine Tune / DreamBooth Stable Diffusion XL (SDXL) with only 10.3 GB VRAM via OneTrainer | dev.to | 2024-03-25Used SG161222/RealVisXL_V4.0 as a base model and OneTrainer to train on Windows 10 : https://github.com/Nerogar/OneTrainer
Project mention: Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing | news.ycombinator.com | 2024-04-07
slowllama: Finetune llama2-70b and codellama on MacBook Air without quantization [Link].
Project mention: 25 million Creative Commons image dataset released! | /r/StableDiffusion | 2023-10-01Github: https://github.com/ml6team/fondant
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python fine-tuning discussion
Python fine-tuning related posts
-
penzai: JAX research toolkit for building, editing, and visualizing neural nets
-
Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing
-
LlamaIndex: A data framework for your LLM applications
-
LlamaIndex is a data framework for your LLM applications
-
Now You Can Full Fine Tune / DreamBooth Stable Diffusion XL (SDXL) with only 10.3 GB VRAM via OneTrainer
-
Geniusrise – Wannabe Competitor to Vertex AI, Azure AI Studio and Bedrock
-
Show HN: GPU Prices on eBay
-
A note from our sponsor - InfluxDB
www.influxdata.com | 16 Jun 2024
Index
What are some of the best open-source fine-tuning projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | llama_index | 32,542 |
| 2 | LLaMA-Factory | 23,973 |
| 3 | ludwig | 10,936 |
| 4 | h2o-llmstudio | 3,722 |
| 5 | xTuring | 2,545 |
| 6 | YiVal | 2,483 |
| 7 | custom-diffusion | 1,795 |
| 8 | penzai | 1,503 |
| 9 | finetuner | 1,443 |
| 10 | OneTrainer | 1,256 |
| 11 | TencentPretrain | 991 |
| 12 | LLM-Adapters | 979 |
| 13 | SPIN | 857 |
| 14 | Lora-for-Diffusers | 723 |
| 15 | LLM-Finetuning-Toolkit | 709 |
| 16 | DataDreamer | 704 |
| 17 | slowllama | 428 |
| 18 | simpleT5 | 380 |
| 19 | OneDiffusion | 325 |
| 20 | fondant | 324 |
| 21 | kiri | 240 |
| 22 | Dreambooth | 97 |
| 23 | praetor-data | 63 |
Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com