DALL-E Paper and Code

• DALL-E

  31 10,709 0.0 Python

  PyTorch package for the discrete VAE used for DALL·E.

  

• big-sleep

  62 2,548 0.0 Python

  A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun

Yeah unfortunately OpenAI has only released the weaker resnets and vision transformers they trained.

Some brilliant folks (Ryan Murdock [@advadnoun], Phil Wang [@lucidrains]) have tried to replicate their results with projects like big-sleep [0] with decent results, but even with this improved VAE we're still a ways from DALL-E quality results.

If anyone would like to play with the model check out either the Google Colab [1] (if you wanna run it on Google's cloud) or my site [2] (if you want a simplified UI).

[0]: https://github.com/lucidrains/big-sleep/

[1]: https://colab.research.google.com/drive/1MEWKbm-driRNF8PrU7o...

[2]: https://dank.xyz

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• DALLE-pytorch

  20 5,492 2.5 Python

  Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

The repository linked is just a part of the entire model so it can't be used as is.

That said there is a completely implementation made by lucidrains[1] with some results, the only missing component now is the dataset.

[1]: https://github.com/lucidrains/DALLE-pytorch

Suggest a related project