How To Setup a Model With Guardrails?

• NeMo-Guardrails

  13 3,338 9.9 Python

  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

  

I have been playing around with some models locally and creating a discord bot as a fun side project, and I wanted to setup some guardrails on inputs / outputs of the bot to make sure that it isn't violating any ethical boundaries. I was going to use Nvidia's Nemo guardrails, but they only support openai currently. Are there any other good ways to control inputs?

• RL4LMs

  5 2,084 0.0 Python

  A modular RL library to fine-tune language models to human preferences

  

I think of guardrails as another dimension of human preferences: whether you are training a model to answer questions more gooder or avoid saying horrifying stuff, you are teaching the model a preference. So I thinks it's a straightforward RLHF problem but from a different perspective.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• Dromedary

  5 1,087 7.8 Python

  Dromedary: towards helpful, ethical and reliable LLMs.

  

Suggest a related project