alignment-handbook
WebGLM
alignment-handbook | WebGLM | |
---|---|---|
3 | 1 | |
4,031 | 1,523 | |
5.5% | 1.1% | |
8.6 | 6.8 | |
10 days ago | 10 months ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
alignment-handbook
- Recipes to align LLMs with AI feedback
-
What on-demand GPU service would you recommend to do fine-tuning of 7B models ?
I'd like to run some fine-tuning experiments on 7B models. Specifically, interested to use https://github.com/huggingface/alignment-handbook and run Zephyr-7b recipes on custom datasets. Don't have any viable GPU locally.
- Zephyr 7B β Released
WebGLM
What are some alternatives?
opening-up-chatgpt.github.io - Tracking instruction-tuned LLM openness. Paper: Liesenfeld, Andreas, Alianda Lopez, and Mark Dingemanse. 2023. “Opening up ChatGPT: Tracking Openness, Transparency, and Accountability in Instruction-Tuned Text Generators.” In Proceedings of the 5th International Conference on Conversational User Interfaces. doi:10.1145/3571884.3604316.
embedchain - Personalizing LLM Responses
safe-rlhf - Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
h2ogpt - Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/
argilla - Argilla is a collaboration platform for AI engineers and domain experts that require high-quality outputs, full data ownership, and overall efficiency.
ImageReward - [NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences for Text-to-image Generation
Cornucopia-LLaMA-Fin-Chinese - 聚宝盆(Cornucopia): 中文金融系列开源可商用大模型,并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)
TextRL - Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-176B/bloom/gpt/bart/T5/MetaICL)
LLMSurvey - The official GitHub page for the survey paper "A Survey of Large Language Models".