PromptCraft-Robotics VS visual-chatgpt

People are already creating sophisticated prompts that are literally engineering problems, so prompting has indeed become a tool of its own.

For prompting, the GitHub repo I refer to the most is actually one from Microsoft: https://github.com/Microsoft/Visual-ChatGPT

Found relevant code at https://github.com/microsoft/visual-chatgpt + all code implementations here

Github: https://github.com/microsoft/visual-chatgpt/tree/main/LowCodeLLM will soon be available!

It's not so much the size of the LLMs, it's what people are able to do with them in novel ways, e.g. https://github.com/microsoft/visual-chatgpt/tree/main/TaskMatrix.AI

There is a python library langchain, which microsoft used to give it access to image editing tools. You can write your own tools for it very easily, I've been having fun with it. I gave it internet search tools and it worked great at using current events in the response.

Something like this: https://github.com/microsoft/visual-chatgpt/tree/main/TaskMatrix.AI could enable a far simpler AI to start making copies of itself.

Reminds me of VisualChatGPT (https://github.com/microsoft/visual-chatgpt), which also uses a LLM to decide what vision models to run.

The best Microsoft API or overall API? It really depends what your goal is. https://github.com/huggingface is great if you want to dive right in, but https://github.com/microsoft/visual-chatgpt might be good as well (not easy to get to work locally).