ColossalAI VS dalle-mini

> open-source a complete RLHF pipeline ... based on the LLaMA pre-trained model

I've gotten to where when I see "open source AI" I now know it's "well, except for $some_other_dependencies"

Anyway: https://scribe.rip/@yangyou_berkeley/colossalchat-an-open-so... and https://github.com/hpcaitech/ColossalAI#readme (Apache 2) can save you some medium.com heartache at least

Quick Read: https://www.marktechpost.com/2023/04/01/meet-colossalchat-an-open-source-ai-solution-for-cloning-chatgpt-with-a-complete-rlhf-pipeline/ Github: https://github.com/hpcaitech/ColossalAI Examples: https://chat.colossalai.org/

One of the current methods for training competing models is to have ChatGPT literally create prompt -> completion data sets. That's what was used for https://github.com/hpcaitech/ColossalAI. A model based off of the Llama weights released by facebook, then fine tuned on ChatGPT3.5 prompt + completions. So yes, there is a good chance that google is literally using ChatGPT in the training loop.

Here's the github from the article:

https://github.com/hpcaitech/ColossalAI

The article talks about their RLHF implementation briefly. There’s details on their RLHF implementation here: https://github.com/hpcaitech/ColossalAI/blob/a619a190df71ea3...

Here’s the project on GitHub: https://github.com/hpcaitech/ColossalAI

Mini-Gemini is a bit of a confusing name.

Reminds me of how DALL·E Mini came out three years ago and eventually had to rename itself to Craiyon https://github.com/borisdayma/dalle-mini

I wouldnt consider Craiyon to be high tier equipment

Made with : https://www.craiyon.com/

AI Site

https://www.craiyon.com/ try it, and it's not even that good a text to image generator.

For example used just your prompt on Craiyon , guess you can try on replicate the free sd demos for example.