jupyter-notebook-chatcompletion VS hyde

You can also generate more code based on your project files - which I also did to generate more commands for the extension.

Cell outputs and problems detected by VSCode can be added to the prompt. You can, for example, feed code into the prompt - which I did to generate the first version of the Readme.

HyDE apparently means “Hypothetical Document Embeddings”, which seems to be a kind of generative query expansion/pre-processing

https://arxiv.org/abs/2212.10496

https://github.com/texttron/hyde

From the abstract:

Given a query, HyDE first zero-shot instructs an instruction-following language model (e.g. InstructGPT) to generate a hypothetical document. The document captures relevance patterns but is unreal and may contain false details. Then, an unsupervised contrastively learned encoder~(e.g. Contriever) encodes the document into an embedding vector. This vector identifies a neighborhood in the corpus embedding space, where similar real documents are retrieved based on vector similarity. This second step ground the generated document to the actual corpus, with the encoder's dense bottleneck filtering out the incorrect details.

Quick Read: https://www.marktechpost.com/2023/01/23/meet-hyde-an-effective-fully-zero-shot-dense-retrieval-systems-that-require-no-relevance-supervision-works-out-of-box-and-generalize-across-tasks/ Paper: https://arxiv.org/pdf/2212.10496.pdf Github: https://github.com/texttron/hyde