quivr VS haystack

3. Quivr | GitHub | tutorial

I used Ollama (with Mistral 7B) and Quivr to get a local RAG up and running and it works fine, but was surprised to find there are no easy user-friendly ways to do it. Most other local LLM UIs don't implement this use case (I looked here), even though it is one of the most useful local LLM use-cases I can think of: search and summarize information from sensitive / confidential documents.

In my opinion LLM based document search tools such as OSS Quivr may be better suited for documentation search for startups.

A highly customed Quivr with one of the 'Open Source LLMs' may provides great 'semantic search' for product documentation.

https://github.com/StanGirard/quivr

Hey thanks for creating this, will try later if i have time. Meanwhile, do you try some of other second brain app such as this, and how was the comparison? The one i mentioned was trending on github so i think its decent (been playing with it since last week or so, also). But i already starred your repo so i can come back later.

I was confused for a bit but there is no relation to https://haystack.deepset.ai/

View on GitHub

4. Haystack by Deepset | Github | tutorial

Haystack can be classified as an end-to-end framework for building applications powered by various NLP technologies, including but not limited to generative AI. While it doesn't directly focus on building generative models from scratch, it provides a robust platform for:

But if you want an API that you can use to develop your own flow, Haystack from Deepset could be worth a look.

Haystack for production. We cannot afford breaking changes in our production apps. Its stable, documentation is excellent and did I mention its' STABLE!??

I recently conducted some experiments with Llama2 and Haystack (https://github.com/deepset-ai/haystack), the NLP/LLM framework.

The notebook can be helpful for those trying to load Llama2 on Colab.

1) Installed Transformers from the main branch (and other libraries)