Cornucopia-LLaMA-Fin-Chinese
alignment-handbook
| Cornucopia-LLaMA-Fin-Chinese | alignment-handbook | |
|---|---|---|
| 19 | 3 | |
| 536 | 3,844 | |
| - | 6.9% | |
| 4.4 | 8.6 | |
| 11 months ago | 11 days ago | |
| Python | Python | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Cornucopia-LLaMA-Fin-Chinese
alignment-handbook
- Recipes to align LLMs with AI feedback
-
What on-demand GPU service would you recommend to do fine-tuning of 7B models ?
I'd like to run some fine-tuning experiments on 7B models. Specifically, interested to use https://github.com/huggingface/alignment-handbook and run Zephyr-7b recipes on custom datasets. Don't have any viable GPU locally.
- Zephyr 7B β Released
What are some alternatives?
Baichuan-7B - A large-scale 7B pretraining language model developed by BaiChuan-Inc.
opening-up-chatgpt.github.io - Tracking instruction-tuned LLM openness. Paper: Liesenfeld, Andreas, Alianda Lopez, and Mark Dingemanse. 2023. “Opening up ChatGPT: Tracking Openness, Transparency, and Accountability in Instruction-Tuned Text Generators.” In Proceedings of the 5th International Conference on Conversational User Interfaces. doi:10.1145/3571884.3604316.
ray-llm - RayLLM - LLMs on Ray
WebGLM - WebGLM: An Efficient Web-enhanced Question Answering System (KDD 2023)
tableQA-Chinese - Unsupervised tableQA and databaseQA on chinese finance question and tabular data
safe-rlhf - Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
Chinese-LLaMA-Alpaca - 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
argilla - Argilla is a collaboration platform for AI engineers and domain experts that require high-quality outputs, full data ownership, and overall efficiency.
LLMSurvey - The official GitHub page for the survey paper "A Survey of Large Language Models".
Huatuo-Llama-Med-Chinese - Repo for BenTsao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草（原名：华驼）模型仓库，基于中文医学知识的大语言模型指令微调
peft - 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.