multi-lora-fine-tune
api-for-open-llm
multi-lora-fine-tune | api-for-open-llm | |
---|---|---|
1 | 1 | |
185 | 2,045 | |
17.3% | - | |
9.3 | 9.4 | |
10 days ago | 23 days ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
multi-lora-fine-tune
-
Has anyone tried out the ASPEN-Framework for LoRA Fine-Tuning yet and can share their experience?
I want to train a Code LLaMA on some data, and I am looking for a Framework or Technique to train this on my PC with a 3090 Ti in it. In my research, I stumbled across the paper "ASPEN: High-Throughput LoRA Fine-Tuning of Large Language Models with a Single GPU" https://arxiv.org/abs/2312.02515 with this GitHub project: https://github.com/TUDB-Labs/multi-lora-fine-tune.
api-for-open-llm
What are some alternatives?
unsloth - Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory
flatdraw - A simple canvas drawing web app with responsive UI. Made with TypeScript, React, and Next.js.
Finetune_LLMs - Repo for fine-tuning Casual LLMs
languagetool - Style and Grammar Checker for 25+ Languages
Anima - 33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU
GoLLIE - Guideline following Large Language Model for Information Extraction
towhee - Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
awesome-data-temporality - A curated list to help you manage temporal data across many modalities 🚀.
incubator-fury - A blazingly fast multi-language serialization framework powered by JIT and zero-copy.
llama2.c - Inference Llama 2 in one file of pure C
label-studio - Label Studio is a multi-type data labeling and annotation tool with standardized output format
TLDR-the-TnC - TLDR the T&C uses an LLM to understand the contents of Terms and Conditions documents and provides a user-friendly chatbot interface for users to ask questions and receive answers.