guided-diffusion VS ColossalAI

People who made these colabs better and better also the same people who are at Midjourney now. But the "mother" of it all, was Katherine Crowson. She made a fine tuned model that uses a 512x512 unconditional ImageNet diffusion model fine-tuned from OpenAI's 512x512 class-conditional ImageNet diffusion model (https://github.com/openai/guided-diffusion) together with CLIP (https://github.com/openai/CLIP) to connect text prompts with images. It uses a smaller secondary diffusion model trained by Katherine Crowson to remove noise from intermediate timesteps to prepare them for CLIP.

I am trying to use OpenAI's Guided Diffusion Github to train my own diffusion model. I thought to ask here to see if anyone had any experience with it as I've been having trouble training my own models on it. If anyone has any resources to point me towards it would be greatly appreciated!

Our codebase for the diffusion models builds heavily on OpenAI's ADM codebase , lucidrains, Stable Diffusion, Lightning and Hugging Face. Thanks for open-sourcing!

I am working with guided diffusion. I would like to reproduce the results of the repository for the 64->256 super resolution network. https://github.com/openai/guided-diffusion

this code is (mostly) just the original openai guided diffusion code: https://github.com/openai/guided-diffusion

Starting resource, as it is all done through this code (information on how to do it on Colab is out there) https://github.com/openai/guided-diffusion

Original notebook by Katherine Crowson (https://github.com/crowsonkb, https://twitter.com/RiversHaveWings). It uses either OpenAI's 256x256 unconditional ImageNet or Katherine Crowson's fine-tuned 512x512 diffusion model (https://github.com/openai/guided-diffusion), together with CLIP (https://github.com/openai/CLIP) to connect text prompts with images.

Code for https://arxiv.org/abs/2105.05233 found: https://github.com/openai/guided-diffusion

Paper, repo, Colab. It's really good.

> open-source a complete RLHF pipeline ... based on the LLaMA pre-trained model

I've gotten to where when I see "open source AI" I now know it's "well, except for $some_other_dependencies"

Anyway: https://scribe.rip/@yangyou_berkeley/colossalchat-an-open-so... and https://github.com/hpcaitech/ColossalAI#readme (Apache 2) can save you some medium.com heartache at least

Quick Read: https://www.marktechpost.com/2023/04/01/meet-colossalchat-an-open-source-ai-solution-for-cloning-chatgpt-with-a-complete-rlhf-pipeline/ Github: https://github.com/hpcaitech/ColossalAI Examples: https://chat.colossalai.org/

One of the current methods for training competing models is to have ChatGPT literally create prompt -> completion data sets. That's what was used for https://github.com/hpcaitech/ColossalAI. A model based off of the Llama weights released by facebook, then fine tuned on ChatGPT3.5 prompt + completions. So yes, there is a good chance that google is literally using ChatGPT in the training loop.

Here's the github from the article:

https://github.com/hpcaitech/ColossalAI

The article talks about their RLHF implementation briefly. There’s details on their RLHF implementation here: https://github.com/hpcaitech/ColossalAI/blob/a619a190df71ea3...

Here’s the project on GitHub: https://github.com/hpcaitech/ColossalAI