TencentPretrain
LLM-Adapters
TencentPretrain | LLM-Adapters | |
---|---|---|
1 | 2 | |
983 | 950 | |
1.1% | 3.1% | |
7.6 | 7.3 | |
9 days ago | 2 months ago | |
Python | Python | |
GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
TencentPretrain
LLM-Adapters
-
Google DeepMind CEO Says Some Form of AGI Possible in a Few Years
That is not true, you can for example use an additional adapter to optimize, that takes 50$ and a 1 hour. https://github.com/AGI-Edgerunners/LLM-Adapters
- LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of LLMs
What are some alternatives?
simpleT5 - simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.
discus - A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ
tiger - Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
custom-diffusion - Custom Diffusion: Multi-Concept Customization of Text-to-Image Diffusion (CVPR 2023)
alpaca-lora - Instruct-tune LLaMA on consumer hardware
hierarchical-domain-adaptation - Code of NAACL 2022 "Efficient Hierarchical Domain Adaptation for Pretrained Language Models" paper.
llama-classification - Text classification with Foundation Language Model LLaMA
AGIEval
stanford_alpaca - Code and documentation to train Stanford's Alpaca models, and generate the data.
adapters - A Unified Library for Parameter-Efficient and Modular Transfer Learning
awesome-pretrained-chinese-nlp-models - Awesome Pretrained Chinese NLP Models,高质量中文预训练模型&大模型&多模态模型&大语言模型集合
LLM-Finetuning-Hub - Toolkit for fine-tuning, ablating and unit-testing open-source LLMs. [Moved to: https://github.com/georgian-io/LLM-Finetuning-Toolkit]