clipseg
This repository contains the code of the CVPR 2022 paper "Image Segmentation Using Text and Image Prompts". (by timojl)
dalle-flow
🌊 A Human-in-the-Loop workflow for creating HD images from text (by jina-ai)
| clipseg | dalle-flow | |
|---|---|---|
| 7 | 31 | |
| 1,022 | 2,825 | |
| - | 0.1% | |
| 3.8 | 2.3 | |
| 4 months ago | 12 months ago | |
| Python | Python | |
| GNU General Public License v3.0 or later | - |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
clipseg
Posts with mentions or reviews of clipseg.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-08.
-
How to blend a logo or clip art to a design
Following the comments to this old post, I tried to use in-painting with manual mask selection. I didn't get beautiful results but I'm sure with some tweaking, I could make it better. The main problem I had was having to manually select the area where I wanted to place the logo and trying to resize my logo mask to the fit the segment. I tried some automatic segmentation tools (Clipseg and Segment Anything). I couldn't tell the segmentation models to find a good area to for logo placement (i.e. some small flat surface). Given the complexity of what I was dealing with, I think there could be a better way (XY problem).
-
New Feature: "ZOOM ENHANCE" for the A111 WebUI. Automatically fix small details like faces and hands!
The addon utilizes clipseg for region masking, which was trained on "an extended version of the PhraseCut dataset" (many thousands of images.)
-
Txt2mask just received a big update!! 🎅
You'll also need to make sure to update your clipseg repo. The script won't do this for you. Namely you just need to update this models/clipseg.py file to ensure your clipseg has support for the new model.
-
[P] Image search with localization and open-vocabulary reranking.
For localisation at search time I ended up using OWL-ViT. This worked really well. I did not try Detic or CLIPseg but would be interested to hear if anyone else has tried these?
-
Who needs prompt2prompt anyway? SD 1.5 inpainting model with clipseg prompt for "hair" and various prompts for different hair colors
clipseg is an image segmentation method used to find a mask for an image from a prompt. I implemented it as an executor for dalle-flow and added it to my bot yasd-discord-bot.
-
txt2mask working in imaginAIry python library
Automated Replacement (txt2mask) by clipseg
- txt2mask was just released! We don't have to use the brush tool for inpainting anymore!
dalle-flow
Posts with mentions or reviews of dalle-flow.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-02-14.
-
How to Personalize Stable Diffusion for ALL the Things
Jina AI is really into generative AI. It started out with DALL·E Flow, swiftly followed by DiscoArt. And then…🦗🦗*🦗🦗. At least for a while…
-
image generation API similar to Dall-E or Dall-E 2
you can host your own https://github.com/jina-ai/dalle-flow
-
[hlky’s/sd-webui] Announcing Sygil.dev & Project Nataili
For example for all the multimodal stuff like clipseg and upscalers, I'm using isolated executors through jina flow: https://github.com/jina-ai/dalle-flow/tree/main/executors
-
Who needs prompt2prompt anyway? SD 1.5 inpainting model with clipseg prompt for "hair" and various prompts for different hair colors
clipseg is an image segmentation method used to find a mask for an image from a prompt. I implemented it as an executor for dalle-flow and added it to my bot yasd-discord-bot.
-
Sequential token weighting invented by Birch-san@Github allows you to bypass the 77 token limit and use any amount of tokens you want, also allows you to sequentially alter an image
Merged into [dalle-flow](https://github.com/jina-ai/dalle-flow/pull/112) this morning and works on my Discord bot [yasd-discord-bot](https://github.com/AmericanPresidentJimmyCarter/yasd-discord-bot).
-
I made a discord bot for artsy ML stuff - just finished integrating SD
https://github.com/jina-ai/dalle-flow with ports of some code from https://github.com/lstein/stable-diffusion plus some stuff specific to my uses (mostly more exposed settings and meta data on the outputs).
-
AI generated picture "Beatles at Disneyland"
dalle flow - a more advanced version of dall-e mini, running dall-e mega and a diffusion model (free colab), free
- Comparison of DALL-E, Midjourney, Stable Diffusion and more
-
Running Dall-e mini on Windows? (Or: Are there any equivalent text-to-image AI's I can run on a windows PC with a 2080 TI?)
Another option is https://github.com/jina-ai/dalle-flow combines DALL-E Mini with some other image processing models, and they have a pre-built Docker image that you could run locally. However, because it loads additional image processing models, you'll need about 21 GB of GPU RAM which is more than a 2080 TI has. You could always try to edit their Dockerfile and re-build it to remove the other models.
-
Run Your Own DALL·E Mini (Craiyon) Server on EC2
For the second half of this article, we’ll use meadowdata/meadowrun-dallemini-demo which contains a notebook for running multiple models as sequential batch jobs to generate images using Meadowrun. The combination of models is inspired by jina-ai/dalle-flow.
What are some alternatives?
When comparing clipseg and dalle-flow you can also consider the following projects:
stable-diffusion - Latent Text-to-Image Diffusion
dalle-mini - DALL·E Mini - Generate images from a text prompt
Detic - Code release for "Detecting Twenty-thousand Classes using Image-level Supervision".
jina - ☁️ Build multimodal AI applications with cloud-native stack
LAVIS - LAVIS - A One-stop Library for Language-Vision Intelligence
BasicSR - Open Source Image and Video Restoration Toolbox for Super-resolution, Denoise, Deblurring, etc. Currently, it includes EDSR, RCAN, SRResNet, SRGAN, ESRGAN, EDVR, BasicVSR, SwinIR, ECBSR, etc. Also support StyleGAN2, DFDNet.
imaginAIry - Pythonic AI generation of images and videos
example-app-store - App store search example, using Jina as backend and Streamlit as frontend
txt2mask - Automatically create masks for Stable Diffusion inpainting using natural language.
dalle-playground - A playground to generate images from any text prompt using Stable Diffusion (past: using DALL-E Mini)
unprompted - Templating language written for Stable Diffusion workflows. Available as an extension for the Automatic1111 WebUI.
dalle2-in-python - Use DALL·E 2 in Python