InfluxDB Platform is powered by columnar analytics, optimized for cost-efficient storage, and built with open data standards. Learn more →
Top 23 Python fine-tuning Projects
-
-
Scout Monitoring
Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
-
Project mention: Llama-Factory: A WebUI for Efficient Fine-Tuning of 100 LLMs | news.ycombinator.com | 2024-07-17
-
Project mention: Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing | news.ycombinator.com | 2024-04-07
This is a great project, little bit similar to https://github.com/ludwig-ai/ludwig, but it includes testing capabilities and ablation.
questions regarding the LLM testing aspect: How extensive is the test coverage for LLM use cases, and what is the current state of this project area? Do you offer any guarantees, or is it considered an open-ended problem?
Would love to see more progress toward this area!
-
OpenLLM
Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
OpenLLM is a powerful platform that empowers developers to leverage the potential of open-source large language models (LLMs). It is like a Swiss Army knife for LLMs. It's a set of tools that helps developers overcome these deployment hurdles.
-
h2o-llmstudio
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
-
Project mention: YiVal——Unlocking Your Data's Power to Create Customized GenAI Apps | /r/u_YiVal | 2023-11-16
- 🤖Github:https://github.com/YiVal/YiVal/pull/189
-
xTuring
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
-
InfluxDB
Purpose built for real-time analytics at any scale. InfluxDB Platform is powered by columnar analytics, optimized for cost-efficient storage, and built with open data standards.
-
custom-diffusion
Custom Diffusion: Multi-Concept Customization of Text-to-Image Diffusion (CVPR 2023)
-
For object inspection in Jupyter if doing more numpy type things, check out penzai: https://github.com/google-deepmind/penzai
-
Project mention: Now You Can Full Fine Tune / DreamBooth Stable Diffusion XL (SDXL) with only 10.3 GB VRAM via OneTrainer | dev.to | 2024-03-25
Used SG161222/RealVisXL_V4.0 as a base model and OneTrainer to train on Windows 10 : https://github.com/Nerogar/OneTrainer
-
-
DB-GPT-Hub
A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL
-
dstack
A lightweight alternative to Kubernetes for AI, simplifying container orchestration on any cloud or on-premises and accelerating AI development, training, and deployment.
Project mention: dstack (K8s alternative) adds support for AMD accelerators on RunPod | news.ycombinator.com | 2024-08-21That’s on our list! We’re actually planning to expand our examples page with a lot more frameworks! Contributors are very welcome to our repo: https://github.com/dstackai/dstack/tree/master/examples/
-
LLM-Adapters
Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
-
-
-
Project mention: LongWriter solves the problem of LLM having inconsistent context or information | news.ycombinator.com | 2024-08-19
-
-
Project mention: Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing | news.ycombinator.com | 2024-04-07
-
Lora-for-Diffusers
The most easy-to-understand tutorial for using LoRA (Low-Rank Adaptation) within diffusers framework for AI Generation Researchers🔥
-
slowllama: Finetune llama2-70b and codellama on MacBook Air without quantization [Link].
-
simpleT5
simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.
-
Project mention: 25 million Creative Commons image dataset released! | /r/StableDiffusion | 2023-10-01
Github: https://github.com/ml6team/fondant
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python fine-tuning discussion
Python fine-tuning related posts
-
Llama-Factory: A WebUI for Efficient Fine-Tuning of 100 LLMs
-
penzai: JAX research toolkit for building, editing, and visualizing neural nets
-
Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing
-
LlamaIndex: A data framework for your LLM applications
-
LlamaIndex is a data framework for your LLM applications
-
Now You Can Full Fine Tune / DreamBooth Stable Diffusion XL (SDXL) with only 10.3 GB VRAM via OneTrainer
-
Geniusrise – Wannabe Competitor to Vertex AI, Azure AI Studio and Bedrock
-
A note from our sponsor - InfluxDB
www.influxdata.com | 10 Sep 2024
Index
What are some of the best open-source fine-tuning projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | llama_index | 35,307 |
| 2 | LLaMA-Factory | 30,370 |
| 3 | ludwig | 11,078 |
| 4 | OpenLLM | 9,706 |
| 5 | h2o-llmstudio | 3,904 |
| 6 | YiVal | 2,614 |
| 7 | xTuring | 2,580 |
| 8 | custom-diffusion | 1,839 |
| 9 | penzai | 1,624 |
| 10 | OneTrainer | 1,593 |
| 11 | finetuner | 1,463 |
| 12 | DB-GPT-Hub | 1,336 |
| 13 | dstack | 1,314 |
| 14 | LLM-Adapters | 1,039 |
| 15 | TencentPretrain | 1,011 |
| 16 | SPIN | 944 |
| 17 | LongWriter | 977 |
| 18 | DataDreamer | 787 |
| 19 | LLM-Finetuning-Toolkit | 757 |
| 20 | Lora-for-Diffusers | 754 |
| 21 | slowllama | 441 |
| 22 | simpleT5 | 381 |
| 23 | fondant | 336 |
Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com