punica
LLM-Finetuning-Hub
| punica | LLM-Finetuning-Hub | |
|---|---|---|
| 1 | 6 | |
| 831 | 638 | |
| 5.5% | - | |
| 8.7 | 9.5 | |
| 14 days ago | about 1 month ago | |
| Python | Python | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
punica
LLM-Finetuning-Hub
-
Zephyr-7B QLoRA Benchmark for Summarization and Classification
Hi everyone, we've been working on benchmarking different open-source LLMs. We measure, in particular, on the performance of these models once finetued (via QLoRA) on classic NLP downstream tasks like summarization and classification. We also put particular emphasis on benchmarking inference time/cost for these models once deployed.
-
Show HN: Finetuning LLMs: Open-source vs. Close-source
Hello all,
I have been working on benchmarking different LLMs -- both open-source and closed-source.
Repo: https://github.com/georgian-io/LLM-Finetuning-Hub
Precisely, I am comparing their out-of-the-box capabilities (prompting) and their fine-tuned conterparts!
So far, the following models have been benchmarked:
Open-Source:
- FLaNK Stack Weekly for 12 September 2023
- [P][R] Finetune LLMs via the Finetuning Hub
-
Show HN: Leverage Falcon 7B blog post
- Finetuning with QLoRA
I evaluate how Falcon does on classification tasks when compared to Bert and Distilbert.
Moreover, I talk about different ways you can deploy the model, and the associated costs!
The code for all of my experiments are available on: https://github.com/georgian-io/LLM-Finetuning-Hub
Happy reading and learning!
- Show HN: LLM Finetuning Hub
What are some alternatives?
llama-peft-tuner - Tune LLaMa-7B on Alpaca Dataset using PEFT / LORA Based on @zphang's https://github.com/zphang/minimal-llama scripts.
ChatDev - Create Customized Software using Natural Language Idea (through LLM-powered Multi-Agent Collaboration)
LongLoRA - Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)
bedframe - Your Browser Extension Development Framework
FastLoRAChat - Instruct-tune LLaMA on consumer hardware with shareGPT data
wasmer-java - ☕ WebAssembly runtime for Java
lora-instruct - Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA
llm-toys - Small(7B and below) finetuned LLMs for a diverse set of useful tasks
Zicklein - Finetuning instruct-LLaMA on german datasets.
go-llama2 - Llama 2 inference in one file of pure Go
sqllineage - SQL Lineage Analysis Tool powered by Python
rivet - The open-source visual AI programming environment and TypeScript library