LLM-Adapters
VL_adapter
LLM-Adapters | VL_adapter | |
---|---|---|
2 | 1 | |
960 | 193 | |
4.1% | - | |
7.3 | 0.0 | |
2 months ago | over 1 year ago | |
Python | Python | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
LLM-Adapters
-
Google DeepMind CEO Says Some Form of AGI Possible in a Few Years
That is not true, you can for example use an additional adapter to optimize, that takes 50$ and a 1 hour. https://github.com/AGI-Edgerunners/LLM-Adapters
- LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of LLMs
VL_adapter
-
[P] Using LoRA to efficiently fine-tune diffusion models. Output model less than 4MB, two times faster to train, with better performance. (Again, with Stable Diffusion)
Found relevant code at https://github.com/ylsung/VL_adapter + all code implementations here
What are some alternatives?
TencentPretrain - Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
LoRA - Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
discus - A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ
MMD-GAN - Training MMD GANs.
custom-diffusion - Custom Diffusion: Multi-Concept Customization of Text-to-Image Diffusion (CVPR 2023)
VLDet - [ICLR 2023] PyTorch implementation of VLDet (https://arxiv.org/abs/2211.14843)
hierarchical-domain-adaptation - Code of NAACL 2022 "Efficient Hierarchical Domain Adaptation for Pretrained Language Models" paper.
torch-adapters - Small Library of PyTorch Adaptation modules
AGIEval
adapters - A Unified Library for Parameter-Efficient and Modular Transfer Learning
LLM-Finetuning-Hub - Toolkit for fine-tuning, ablating and unit-testing open-source LLMs. [Moved to: https://github.com/georgian-io/LLM-Finetuning-Toolkit]
trankit - Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing