pandora VS github-chatgpt-plugin

It's still surprising when you see it do something like this for the first time.

I wrote a plugin to give ChatGPT access to execute plugins in a Docker container [0]. The first time it said something like "I'm going to use Python for this, oh, it's not installed, I'll install it now and run the script I just made", I was pretty amazed.

What I've come to realise is that although ChatGPT is excellent at telling _people_ how to interact with systems, it's not very good at interacting with them itself, as it isn't trained to understand it's own limitations. For example it knows people can run dmesg and look at the last few lines to debug some system problems. But if ChatGPT ran dmesg, the output would blow through the context window length and it'd get confused.

[0] https://github.com/dave1010/pandora

dave1010/pandora: Pandora gives ChatGPT the ability to read and write files and run commands on your machine. (github.com)

Link to the project: https://github.com/dave1010/pandora

I had a similar idea and made a plugin called Pandora that also lets you run commands: https://github.com/dave1010/pandora

I found the source code[1] for the plugin and it's pretty impressive how much GPT-4 does with so little. I thought maybe the plugin had prompts that would help tell GPT-4 that it should open an issue in some cases but I'm not seeing it. The plugin probably should add something to prevent this behavior in the prompt[2].

1: https://github.com/aavetis/github-chatgpt-plugin