kor VS rasa

Check out kor

Extract structured data from text using LLMs (https://github.com/eyurtsev/kor)

Check out https://github.com/eyurtsev/kor

You're absolutely correct, and I agree that there's potentially a risk of quality loss. But likewise, since these are all intrinsically linked, it may be possible to leverage strength by combining these tasks. I'm unaware of a paper reviewing the reliability and/or performance of LLMs in this specific scenario. If you find any, do share :) With regards to generating JSON responses - there are simple ways to nudge the model and even validate it, using libraries such as https://github.com/promptslab/Promptify, https://github.com/eyurtsev/kor and https://github.com/ShreyaR/guardrails

Currently, I'm experimenting with GPT-3.5-turbo in conjunction with the kor library (langchain for information extraction) to define a prompt template with various examples of what I'm looking for.

yes. there are a few approaches which i intend to take and some helpful resources:

You could implement a Dual LLM Pattern Model https://simonwillison.net/2023/Apr/25/dual-llm-pattern/

You could also leverage a concept like Kor which is a kind of pydantic for LLMs: https://github.com/eyurtsev/kor

in short and as mentioned in the README.md this is absolutely vulnerable to prompt injection. I think this is not a fully solved issue but some interesting community research has been done to help address these things in production

Support Rasa on GitHub ⭐

It itself is not a GPT. It is a a framework of a framework project built on top of Rasa (https://github.com/RasaHQ/rasa) and Langchain which by default uses gpt3.5-turbo (change it in the .env file) or any foundation model you wish.

There was already a GitHub issue https://github.com/RasaHQ/rasa/issues/11084 but it seems like there was no solution provided.

Rasa - also an open source platform. You can use it to build chatbots that are more in line with customer service and sales. Reading that, it’s kind of a big yikes for people under this kind of job knowing you can automate a part of their job via a chatbot. I think they also have a Pro version which is an extension that has additional analytics and probably more security features. I probably will check out the Open source one first and maybe ask about what the Pro version is.

At the moment it can recognise the type of statements in the training data set [1] and transpile them to Python, Java or C++ using the mappings defined here [2].

This is very different from how Codex/Autopilot work as it is trained using an NLU framework [3] which is usually used for training chatbots.

[1]: https://github.com/Flex-lang/transpiler/tree/master/transpil...

[2]: https://github.com/Flex-lang/transpiler/tree/master/transpil...

[3]: https://github.com/RasaHQ/rasa

Check out Rasa

It looks like it is built upon a Chatbot platform called “messengerx.io”, which itself seems to be built upon an open-source/machine-learning framework for voice/text conversations called “Rasa”

Use Python and use the Rasa framework to make a chat bot. https://rasa.com/docs/

This example is sourced from RasaHQ