Has anyone tried out the ASPEN-Framework for LoRA Fine-Tuning yet and can share their experience?

• multi-lora-fine-tune

  1 182 9.3 Python

  Provide Efficient LLM Fine-Tune via Multi-LoRA Optimization

  

I want to train a Code LLaMA on some data, and I am looking for a Framework or Technique to train this on my PC with a 3090 Ti in it. In my research, I stumbled across the paper "ASPEN: High-Throughput LoRA Fine-Tuning of Large Language Models with a Single GPU" https://arxiv.org/abs/2312.02515 with this GitHub project: https://github.com/TUDB-Labs/multi-lora-fine-tune.

• unsloth

  15 8,282 9.4 Python

  Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory

  

https://github.com/unslothai/unsloth seems good and more relevant to your aims perhaps but I haven't tried it.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project