NeMo-Guardrails
hnsqlite
| NeMo-Guardrails | hnsqlite | |
|---|---|---|
| 13 | 6 | |
| 3,373 | 143 | |
| 4.7% | 1.4% | |
| 9.9 | 5.5 | |
| 5 days ago | 10 months ago | |
| Python | Python | |
| GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
NeMo-Guardrails
- NeMO Guardrails from Nvidia
-
Run and create custom ChatGPT-like bots with OpenChat
- https://github.com/NVIDIA/NeMo-Guardrails/
- LangChain: The Missing Manual
-
The Dual LLM pattern for building AI assistants that can resist prompt injection
Here's "jailbreak detection", in the NeMo-Guardrails project from Nvidia:
https://github.com/NVIDIA/NeMo-Guardrails/blob/327da8a42d5f8...
I.e. they ask the llm if the prompt will break the llm. (I believe that more data /some evaluation on how well this performs is intended to be released. Probably fair to call this stuff "not battle tested".)
-
How To Setup a Model With Guardrails?
I have been playing around with some models locally and creating a discord bot as a fun side project, and I wanted to setup some guardrails on inputs / outputs of the bot to make sure that it isn't violating any ethical boundaries. I was going to use Nvidia's Nemo guardrails, but they only support openai currently. Are there any other good ways to control inputs?
-
RasaGPT: First headless LLM chatbot built on top of Rasa, Langchain and FastAPI
Thanks, I hadn't seen those. I did find https://github.com/NVIDIA/NeMo-Guardrails earlier but haven't looked into it yet.
I'm not sure it solves the problem of restricting the information it uses though. For example, as a proof of concept for a customer, I tried providing information from a vector database as context, but GPT would still answer questions that were not provided in that context. It would base its answers on information that was already crawled from the customer website and in the model. That is concerning because the website might get updated but you can't update the model yourself (among other reasons).
- How do we prevent prompt injection in a GPT API app?
- Nvidia NeMo Guardrails – open-source guardrails to conversational systems
-
Should LangChain be used in Prod?
you can use guard rails with langchain - https://github.com/NVIDIA/NeMo-Guardrails
hnsqlite
-
LangChain: The Missing Manual
For anyone thinking about applications of langchain and pinecone but who are looking for something more turn-key check out https://jiggy.ai
The core is actually open source as well, allowing you to take your data back out via sqlite and hnswlib (https://github.com/jiggy-ai/hnsqlite)
-
I built an open source website that lets you upload large files, such as in-depth novels or academic papers, and ask ChatGPT questions based on your specific knowledge base. So far, I've tested it with long books like the Odyssey and random research papers that I like, and it works shockingly well.
We are built on open core https://github.com/jiggy-ai. Our open source hnsqlite is light weight, easy to use. And best of all, we make it easy for you to get your data out of JiggyBase. You can download a sqlite file that contains your document text data, metadata, embedding vectors, and embedding index. This can be used directly in the open source hnsqlite package.
-
What Is a Vector Database
After working through several projects that utilized local hnswlib and different databases for text and vector persistence, I integrated open source hnswlib with sqlite to create an embedded vector search engine that can easily scale up to millions of embeddings. For self-hosted situations of under 10M embeddings and less than insane throughput I think this combo is hard to beat.
https://github.com/jiggy-ai/hnsqlite
- Show HN: Hnsqlite: hnswlib and SQLite integrated for text embedding search
-
Faiss: A library for efficient similarity search
Thanks Leobg!
For anyone else: you pass it directly in metadata see https://github.com/jiggy-ai/hnsqlite/blob/main/test/test_col...
What are some alternatives?
guidance - A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance]
langchainrb - Build LLM-powered applications in Ruby
guidance - A guidance language for controlling large language models.
annoy - Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk
lmql - A language for constraint-guided and efficient LLM programming.
GPT4Memory
basaran - Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
raft - RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
ann-benchmarks - Benchmarks of approximate nearest neighbor libraries in Python