SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 fine-tuning Open-Source Projects
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
flyte
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
-
h2o-llmstudio
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/
-
xTuring
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
custom-diffusion
Custom Diffusion: Multi-Concept Customization of Text-to-Image Diffusion (CVPR 2023)
-
-
-
-
-
-
-
LLM-Adapters
Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
-
Lora-for-Diffusers
The most easy-to-understand tutorial for using LoRA (Low-Rank Adaptation) within diffusers framework for AI Generation Researchers🔥
-
-
-
Magick
Magick is a cutting-edge toolkit for a new kind of AI builder. Make Magick with us! (by Oneirocom)
-
start-llms
A complete guide to start and improve your LLM skills in 2024 with little background in the field and stay up-to-date with the latest news and state-of-the-art techniques!
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: LlamaIndex: A data framework for your LLM applications | news.ycombinator.com | 2024-04-07
Project mention: Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing | news.ycombinator.com | 2024-04-07This is a great project, little bit similar to https://github.com/ludwig-ai/ludwig, but it includes testing capabilities and ablation.
questions regarding the LLM testing aspect: How extensive is the test coverage for LLM use cases, and what is the current state of this project area? Do you offer any guarantees, or is it considered an open-ended problem?
Would love to see more progress toward this area!
Diffusion unet has an "extended" version nowadays that applies to the resnet part as well as the cross-attention: https://github.com/cloneofsimo/lora
9. Flyte by Union AI | Github | tutorial
Project mention: Paid dev gig: develop a basic LLM PEFT finetuning utility | /r/LocalLLaMA | 2023-06-02
Project mention: I'm developing an open-source AI tool called xTuring, enabling anyone to construct a Language Model with just 5 lines of code. I'd love to hear your thoughts! | /r/machinelearningnews | 2023-09-07Explore the project on GitHub here.
Project mention: YiVal——Unlocking Your Data's Power to Create Customized GenAI Apps | /r/u_YiVal | 2023-11-16- 🤖Github:https://github.com/YiVal/YiVal/pull/189
Project mention: A comprehensive guide to building RAG-based LLM applications for production | news.ycombinator.com | 2023-10-25
Project mention: [Discussion] Guidance on training ML models on Kubernetes | /r/MachineLearning | 2023-05-24You could use https://github.com/kubeflow/training-operator directly.
Project mention: RefactAI: Use best-in-class LLMs for coding in your IDE | news.ycombinator.com | 2024-04-30
Project mention: Now You Can Full Fine Tune / DreamBooth Stable Diffusion XL (SDXL) with only 10.3 GB VRAM via OneTrainer | dev.to | 2024-03-25Used SG161222/RealVisXL_V4.0 as a base model and OneTrainer to train on Windows 10 : https://github.com/Nerogar/OneTrainer
Project mention: Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing | news.ycombinator.com | 2024-04-07
Project mention: Dify, a visual workflow to build/test LLM applications | news.ycombinator.com | 2024-04-22
Project mention: Start with Large Language Models (LLMs) in 2023 | news.ycombinator.com | 2023-11-08
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
fine-tuning related posts
-
RefactAI: Use best-in-class LLMs for coding in your IDE
-
penzai: JAX research toolkit for building, editing, and visualizing neural nets
-
Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing
-
LlamaIndex: A data framework for your LLM applications
-
LlamaIndex is a data framework for your LLM applications
-
Now You Can Full Fine Tune / DreamBooth Stable Diffusion XL (SDXL) with only 10.3 GB VRAM via OneTrainer
-
Geniusrise – Wannabe Competitor to Vertex AI, Azure AI Studio and Bedrock
-
A note from our sponsor - SaaSHub
www.saashub.com | 21 May 2024
Index
What are some of the best open-source fine-tuning projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | llama_index | 31,837 |
| 2 | LLaMA-Factory | 22,453 |
| 3 | ludwig | 10,859 |
| 4 | lora | 6,650 |
| 5 | flyte | 4,853 |
| 6 | h2o-llmstudio | 3,643 |
| 7 | xTuring | 2,531 |
| 8 | YiVal | 2,454 |
| 9 | custom-diffusion | 1,788 |
| 10 | llm-applications | 1,526 |
| 11 | training-operator | 1,477 |
| 12 | penzai | 1,471 |
| 13 | finetuner | 1,435 |
| 14 | refact | 1,436 |
| 15 | OneTrainer | 1,173 |
| 16 | TencentPretrain | 987 |
| 17 | LLM-Adapters | 963 |
| 18 | SPIN | 826 |
| 19 | Lora-for-Diffusers | 707 |
| 20 | LLM-Finetuning-Toolkit | 681 |
| 21 | DataDreamer | 681 |
| 22 | Magick | 620 |
| 23 | start-llms | 429 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com