NeMo-Guardrails VS rasa

- https://github.com/NVIDIA/NeMo-Guardrails/

Here's "jailbreak detection", in the NeMo-Guardrails project from Nvidia:

https://github.com/NVIDIA/NeMo-Guardrails/blob/327da8a42d5f8...

I.e. they ask the llm if the prompt will break the llm. (I believe that more data /some evaluation on how well this performs is intended to be released. Probably fair to call this stuff "not battle tested".)

I have been playing around with some models locally and creating a discord bot as a fun side project, and I wanted to setup some guardrails on inputs / outputs of the bot to make sure that it isn't violating any ethical boundaries. I was going to use Nvidia's Nemo guardrails, but they only support openai currently. Are there any other good ways to control inputs?

Thanks, I hadn't seen those. I did find https://github.com/NVIDIA/NeMo-Guardrails earlier but haven't looked into it yet.

I'm not sure it solves the problem of restricting the information it uses though. For example, as a proof of concept for a customer, I tried providing information from a vector database as context, but GPT would still answer questions that were not provided in that context. It would base its answers on information that was already crawled from the customer website and in the model. That is concerning because the website might get updated but you can't update the model yourself (among other reasons).

you can use guard rails with langchain - https://github.com/NVIDIA/NeMo-Guardrails

Support Rasa on GitHub ⭐

It itself is not a GPT. It is a a framework of a framework project built on top of Rasa (https://github.com/RasaHQ/rasa) and Langchain which by default uses gpt3.5-turbo (change it in the .env file) or any foundation model you wish.

There was already a GitHub issue https://github.com/RasaHQ/rasa/issues/11084 but it seems like there was no solution provided.

Rasa - also an open source platform. You can use it to build chatbots that are more in line with customer service and sales. Reading that, it’s kind of a big yikes for people under this kind of job knowing you can automate a part of their job via a chatbot. I think they also have a Pro version which is an extension that has additional analytics and probably more security features. I probably will check out the Open source one first and maybe ask about what the Pro version is.

At the moment it can recognise the type of statements in the training data set [1] and transpile them to Python, Java or C++ using the mappings defined here [2].

This is very different from how Codex/Autopilot work as it is trained using an NLU framework [3] which is usually used for training chatbots.

[1]: https://github.com/Flex-lang/transpiler/tree/master/transpil...

[2]: https://github.com/Flex-lang/transpiler/tree/master/transpil...

[3]: https://github.com/RasaHQ/rasa

Check out Rasa

It looks like it is built upon a Chatbot platform called “messengerx.io”, which itself seems to be built upon an open-source/machine-learning framework for voice/text conversations called “Rasa”

Use Python and use the Rasa framework to make a chat bot. https://rasa.com/docs/

This example is sourced from RasaHQ