awesome-transformer-nlp
RL4LMs
awesome-transformer-nlp | RL4LMs | |
---|---|---|
1 | 5 | |
1,038 | 2,101 | |
- | 2.3% | |
7.3 | 0.0 | |
7 days ago | 3 months ago | |
Python | ||
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
awesome-transformer-nlp
-
Best option for creating a custom GPT AI
This is a helpful resource. https://github.com/cedrickchee/awesome-transformer-nlp
RL4LMs
-
How To Setup a Model With Guardrails?
I think of guardrails as another dimension of human preferences: whether you are training a model to answer questions more gooder or avoid saying horrifying stuff, you are teaching the model a preference. So I thinks it's a straightforward RLHF problem but from a different perspective.
-
OpenDILab Awesome Paper Collection: RL with Human Feedback (2)
Found relevant code at https://github.com/allenai/rl4lms + all code implementations here
-
Best option for creating a custom GPT AI
If you skip down ther s several open source options. https://github.com/allenai/RL4LMs is an example.
- Will we ever see an open source alternative to ChatGPT?
- An Open-Source Version of ChatGPT is Coming [News]
What are some alternatives?
awesome-chatgpt - Curated list of ChatGPT related resource, tools, prompts, apps / ChatGPT 相關優質資源、工具、應用的精選清單。
trlx - A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
KoGPT - GPT-2 pretrained on Korean datasets.
Dromedary - Dromedary: towards helpful, ethical and reliable LLMs.
awesome-language-agents - List of language agents based on paper "Cognitive Architectures for Language Agents"
PaLM-rlhf-pytorch - Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
valhalla-nmt - Code repository for CVPR 2022 paper "VALHALLA: Visual Hallucination for Machine Translation"
Open-Assistant - OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
NeMo-Guardrails - NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
ColossalAI - Making large AI models cheaper, faster and more accessible