NeMo-Guardrails
OpenChat
| NeMo-Guardrails | OpenChat | |
|---|---|---|
| 13 | 13 | |
| 3,373 | 5,057 | |
| 4.7% | 0.4% | |
| 9.9 | 9.5 | |
| 5 days ago | 2 months ago | |
| Python | JavaScript | |
| GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
NeMo-Guardrails
- NeMO Guardrails from Nvidia
-
Run and create custom ChatGPT-like bots with OpenChat
- https://github.com/NVIDIA/NeMo-Guardrails/
- LangChain: The Missing Manual
-
The Dual LLM pattern for building AI assistants that can resist prompt injection
Here's "jailbreak detection", in the NeMo-Guardrails project from Nvidia:
https://github.com/NVIDIA/NeMo-Guardrails/blob/327da8a42d5f8...
I.e. they ask the llm if the prompt will break the llm. (I believe that more data /some evaluation on how well this performs is intended to be released. Probably fair to call this stuff "not battle tested".)
-
How To Setup a Model With Guardrails?
I have been playing around with some models locally and creating a discord bot as a fun side project, and I wanted to setup some guardrails on inputs / outputs of the bot to make sure that it isn't violating any ethical boundaries. I was going to use Nvidia's Nemo guardrails, but they only support openai currently. Are there any other good ways to control inputs?
-
RasaGPT: First headless LLM chatbot built on top of Rasa, Langchain and FastAPI
Thanks, I hadn't seen those. I did find https://github.com/NVIDIA/NeMo-Guardrails earlier but haven't looked into it yet.
I'm not sure it solves the problem of restricting the information it uses though. For example, as a proof of concept for a customer, I tried providing information from a vector database as context, but GPT would still answer questions that were not provided in that context. It would base its answers on information that was already crawled from the customer website and in the model. That is concerning because the website might get updated but you can't update the model yourself (among other reasons).
- How do we prevent prompt injection in a GPT API app?
- Nvidia NeMo Guardrails – open-source guardrails to conversational systems
-
Should LangChain be used in Prod?
you can use guard rails with langchain - https://github.com/NVIDIA/NeMo-Guardrails
OpenChat
-
Open source Q&A chatbot UI Recommendation?
Any recommendations for an open source repos that support web based chat ui where you can upload docs,pds,links,etc? So far i found https://github.com/openchatai/OpenChat but it doesnt support llama, claude, etc. Theres also https://github.com/h2oai/h2ogpt but their gradio UI is overly complicated (meant for technical people) and not user friendly.
-
OpenCopilot – AI Copilot (sidekick) for your own SaaS product
I think that is fair.
I deleted the old custom license and replaced it with MIT license.
https://github.com/openchatai/OpenChat/blob/main/LICENSE
We will also make sure that MIT is our to-go license in the coming projects.
- OpenChat - LLMs custom-chatbots console
-
Run and create custom ChatGPT-like bots with OpenChat
I just wrote a GitHub issue outlining some questions I have about this project. I presume will get deleted soon so I'm posting here:
https://github.com/openchatai/OpenChat/issues/43
- You can upload your entire codebase/git repo to OpenChat and ask GPT-3 to implement whatever you want. it will have the full context of your code base and it will answer your questions in the same style it's written in your codebase.
- OpenChat - Custom ChatGPT for anything (with ability to embed the chatbot on your website as a widget)
- Show HN: OpenChat – Open-Source LLM chatbots console
What are some alternatives?
guidance - A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance]
llama-api-server - A OpenAI API compatible REST server for llama.
langchainrb - Build LLM-powered applications in Ruby
guidance - A guidance language for controlling large language models.
simpleAI - An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.
lmql - A language for constraint-guided and efficient LLM programming.
gpt-jargon - Jargon is a natural language programming language specified and executed by LLMs like GPT-4.
basaran - Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
convostack - Plug and play embeddable AI chatbot widget and backend deployment framework
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.