Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev. Learn more →
NeMo-Guardrails Alternatives
Similar projects and alternatives to NeMo-Guardrails
-
guidance
A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)
-
-
Onboard AI
Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.
-
-
basaran
Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
-
-
-
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
-
InfluxDB
Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
-
-
-
rasa
💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
-
-
RasaGPT
💬 RasaGPT is the first headless LLM chatbot platform built on top of Rasa and Langchain. Built w/ Rasa, FastAPI, Langchain, LlamaIndex, SQLModel, pgvector, ngrok, telegram
-
-
motorhead
🧠 Motorhead is a memory and information retrieval server for LLMs.
-
-
simpleAI
An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.
-
gpt-jargon
Jargon is a natural language programming language specified and executed by LLMs like GPT-4.
-
-
hnsqlite
hnsqlite integrates hnswlib and sqlite for simple text embedding search
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NeMo-Guardrails reviews and mentions
-
Run and create custom ChatGPT-like bots with OpenChat
- https://github.com/NVIDIA/NeMo-Guardrails/
Yes, this is feasible.
Look into https://github.com/NVIDIA/NeMo-Guardrails and specifically to your question there are "topical rails" to ensure the conversation stays on a set of topics you greenlighted.
Also takes care of jailbreaks and allows custom conversation flow templates.
- LangChain: The Missing Manual
-
The Dual LLM pattern for building AI assistants that can resist prompt injection
Here's "jailbreak detection", in the NeMo-Guardrails project from Nvidia:
https://github.com/NVIDIA/NeMo-Guardrails/blob/327da8a42d5f8...
I.e. they ask the llm if the prompt will break the llm. (I believe that more data /some evaluation on how well this performs is intended to be released. Probably fair to call this stuff "not battle tested".)
-
How To Setup a Model With Guardrails?
I have been playing around with some models locally and creating a discord bot as a fun side project, and I wanted to setup some guardrails on inputs / outputs of the bot to make sure that it isn't violating any ethical boundaries. I was going to use Nvidia's Nemo guardrails, but they only support openai currently. Are there any other good ways to control inputs?
-
RasaGPT: First headless LLM chatbot built on top of Rasa, Langchain and FastAPI
Thanks, I hadn't seen those. I did find https://github.com/NVIDIA/NeMo-Guardrails earlier but haven't looked into it yet.
I'm not sure it solves the problem of restricting the information it uses though. For example, as a proof of concept for a customer, I tried providing information from a vector database as context, but GPT would still answer questions that were not provided in that context. It would base its answers on information that was already crawled from the customer website and in the model. That is concerning because the website might get updated but you can't update the model yourself (among other reasons).
-
Should LangChain be used in Prod?
you can use guard rails with langchain - https://github.com/NVIDIA/NeMo-Guardrails
-
A note from our sponsor - Onboard AI
getonboard.dev | 7 Dec 2023
Stats
NVIDIA/NeMo-Guardrails is an open source project licensed under GNU General Public License v3.0 or later which is an OSI approved license.
The primary programming language of NeMo-Guardrails is Python.