alignment-handbook
Cornucopia-LLaMA-Fin-Chinese
alignment-handbook | Cornucopia-LLaMA-Fin-Chinese | |
---|---|---|
3 | 19 | |
3,935 | 552 | |
9.0% | - | |
8.6 | 4.4 | |
14 days ago | 11 months ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
alignment-handbook
- Recipes to align LLMs with AI feedback
-
What on-demand GPU service would you recommend to do fine-tuning of 7B models ?
I'd like to run some fine-tuning experiments on 7B models. Specifically, interested to use https://github.com/huggingface/alignment-handbook and run Zephyr-7b recipes on custom datasets. Don't have any viable GPU locally.
- Zephyr 7B β Released
Cornucopia-LLaMA-Fin-Chinese
What are some alternatives?
opening-up-chatgpt.github.io - Tracking instruction-tuned LLM openness. Paper: Liesenfeld, Andreas, Alianda Lopez, and Mark Dingemanse. 2023. “Opening up ChatGPT: Tracking Openness, Transparency, and Accountability in Instruction-Tuned Text Generators.” In Proceedings of the 5th International Conference on Conversational User Interfaces. doi:10.1145/3571884.3604316.
Baichuan-7B - A large-scale 7B pretraining language model developed by BaiChuan-Inc.
WebGLM - WebGLM: An Efficient Web-enhanced Question Answering System (KDD 2023)
ray-llm - RayLLM - LLMs on Ray
safe-rlhf - Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
tableQA-Chinese - Unsupervised tableQA and databaseQA on chinese finance question and tabular data