stylegan2-clip-approach
Navigating StyleGAN2 w latent space using CLIP (by l4rz)
clip-glass
Repository for "Generating images from caption and vice versa via CLIP-Guided Generative Latent Space Search" (by galatolofederico)
| stylegan2-clip-approach | clip-glass | |
|---|---|---|
| 1 | 13 | |
| 55 | 177 | |
| - | - | |
| 1.8 | 0.0 | |
| over 2 years ago | over 2 years ago | |
| Python | Python | |
| - | GNU General Public License v3.0 only |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
stylegan2-clip-approach
Posts with mentions or reviews of stylegan2-clip-approach.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-04-03.
-
test
(Added Mar. 7, 2021) StyleGAN2-CLIP-approach.ipynb - Colaboratory by l4rz. Uses StyleGAN to generate images. GitHub. Twitter reference.
clip-glass
Posts with mentions or reviews of clip-glass.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-04-03.
-
test
(Added Feb. 5, 2021) CLIP-GLaSS.ipynb - Colaboratory by Galatolo. Uses BigGAN (default) or StyleGAN to generate images. The GPT2 config is for image-to-text, not text-to-image. GitHub.
-
Image to text models
After a cursory search I found CLIP-GLaSS and CLIP-cap. I've used CLIP-GLaSS in a previous experiment, but found the captions for digital/CG images quite underwhelming. This is understandable since this is not what the model was trained on, but still I'd like to use a better model.
-
[R] end-to-end image captioning
CLIP-GLaSS
- What CLIP-GLaSS thinks Ancient Egyptian computers would look like
-
Texttoimage 3 Images For Text Photo Of Donald
The images were generated using this notebook.
- CLIP-GLaSS prompt: "Screenshot of a video game from the 1930s"
-
[P] List of sites/programs/projects that use OpenAI's CLIP neural network for steering image/video creation to match a text description
The CLIP-GLaSS project has image-to-text functionality (I haven't tried it.)
-
For educational purposes: Text-to-image (3 runs with no cherry-picking, 6 images each) for text "Photo of a Lamborghini painted purple and red" generated using CLIP-GLaSS. config=StyleGAN2_car_d. save_each=50. generations=1000
Link to notebook.
-
Sharing CLIP magic based on OpenAI's blog post via a bit more accessible YT medium. Lmk what u think 🙈 ❤️
CLIP-GLaSS
-
[R] [P] Generating images from caption and vice versa via CLIP-Guided Generative Latent Space Search. Link to code and Google Colab notebook for project CLIP-GLaSS is in a comment.
Github for CLIP-GLaSS is here.
What are some alternatives?
When comparing stylegan2-clip-approach and clip-glass you can also consider the following projects:
DALLECLIP
a-PyTorch-Tutorial-to-Image-Captioning - Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning
Colab-BigGANxCLIP
meshed-memory-transformer - Meshed-Memory Transformer for Image Captioning. CVPR 2020
aphantasia - CLIP + FFT/DWT/RGB = text to image/video
deep-daze - Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
AuViMi - AuViMi stands for audio-visual mirror. The idea is to have CLIP generate its interpretation of what your webcam sees, combined with the words thare are spoken.
Story2Hallucination
stylized-neural-painting - Official Pytorch implementation of the preprint paper "Stylized Neural Painting", in CVPR 2021.
StyleCLIP - Using CLIP and StyleGAN to generate faces from prompts.
stylegan2-clip-approach vs DALLECLIP
clip-glass vs a-PyTorch-Tutorial-to-Image-Captioning
stylegan2-clip-approach vs Colab-BigGANxCLIP
clip-glass vs meshed-memory-transformer
stylegan2-clip-approach vs aphantasia
clip-glass vs deep-daze
stylegan2-clip-approach vs AuViMi
clip-glass vs aphantasia
stylegan2-clip-approach vs Story2Hallucination
clip-glass vs stylized-neural-painting
stylegan2-clip-approach vs deep-daze
clip-glass vs StyleCLIP