SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Python text-to-image Projects
-
DALLE2-pytorch
Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
DALLE-pytorch
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
-
deep-daze
Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
-
Awesome-Prompt-Engineering
This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
big-sleep
A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun
-
CogView
Text-to-Image generation. The repo for NeurIPS 2021 paper "CogView: Mastering Text-to-Image Generation via Transformers".
-
TokenFlow
Official Pytorch Implementation for "TokenFlow: Consistent Diffusion Features for Consistent Video Editing" presenting "TokenFlow" (ICLR 2024)
-
text2room
Text2Room generates textured 3D meshes from a given text prompt using 2D text-to-image models (ICCV2023).
-
CogView2
official code repo for paper "CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers"
-
muse-maskgit-pytorch
Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch
-
stable-diffusion-docker
Run the official Stable Diffusion releases in a Docker container with txt2img, img2img, depth2img, pix2pix, upscale4x, and inpaint.
-
Lora-for-Diffusers
The most easy-to-understand tutorial for using LoRA (Low-Rank Adaptation) within diffusers framework for AI Generation Researchers🔥
-
parti-pytorch
Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch
-
storyteller
Multimodal AI Story Teller, built with Stable Diffusion, GPT, and neural text-to-speech (by jaketae)
-
clip-guided-diffusion
A CLI tool/python module for generating images from text using guided diffusion and CLIP from OpenAI.
-
-
Text-to-Image-Synthesis
Pytorch implementation of Generative Adversarial Text-to-Image Synthesis paper
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
I was showing people Dalle2 last year and telling them how much of an impact an open source solution was going to have on, well, everything to do with art and design. (At the time Stable Diffusion had not released, not even the leak, and all hopes was on https://github.com/lucidrains/DALLE2-pytorch)
Project mention: Google's StyleDrop can transfer style from a single image | /r/StableDiffusion | 2023-06-03If google doesnt, someone like lucidrains probably would implement it, just like he did for imagen and muse.
It all started originally on lucidrains/dalle-pytorch in the months following the release of DALL-E (1). The group started as `dalle-pytorch-replicate` but was never officially "blessed" by Phil Wang who seems to enjoy being a free agent (can't blame him).
https://github.com/lucidrains/DALLE-pytorch/issues/116 is where the discord got kicked off originally. There's a lot of other interactions between us in the github there. You should be able to find when Phil was approached by Jenia Jitsev, Jan Ebert, and Mehdi Cherti (all starting LAION members) who graciously offered the chance to replicate the DALL-E paper using their available compute at the JUWELS and JUWELS Booster HPC system. This all predates Emad's arrival. I believe he showed up around the time guided diffusion and GLIDE, but it may have been a bit earlier.
Data work originally focused on amassing several of the bigger datasets of the time. Getting CC12M downloaded and trained on was something of an early milestone (robvanvolt's work). A lot of early work was like that though, shuffling through CC12M, COCO, etc. with the dalle-pytorch codebase until we got an avocado armchair.
Christophe Schumann was an early contributor as well and great at organizing and rallying. He focused a lot on the early data scraping work for what would become the "LAION5B" dataset. I don't want to credit him with the coding and I'm ashamed to admit I can't recall who did much of the work there - but a distributed scraping program was developed (the name was something@home... not scraping@home?).
The discord link on Phil Wang's readme at dalle-pytorch got a lot of traffic and a lot of people who wanted to pitch in with the scraping effort.
Eventually a lot of people from Eleuther and many other teams mingled with us, some sort of non-profit org was created in Germany I believe for legal purposes. The dataset continued to grow and the group moved from training DALLE's to finetuning diffusion models.
The `CompVis` team were great inspiration at the time and much of their work on VQGAN and then latent diffusion models basically kept us motivated. As I mentioned a personal motivation was Katherine Crowson's work on a variety of things like CLIP-guided vqgan, diffusion, etc.
I believe Emad Mostaque showed up around the time GLIDE was coming out? I want to say he donated money for scrapers to be run on AWS to speed up data collection. I was largely hands off for much of the data scraping process and mostly enjoyed training new models on data we had.
As with any online community things got pretty ill-defined, roles changed over, volunteers came/went, etc. I would hardly call this definitive and that's at least partially the reason it's hard to trace as an outsider. That much of the early history is scattered about GitHub issues and PR's can't have helped though.
Yes, there are a lot of different resources online, especially for generative AI. The Awesome Prompt Engineering github is probably a good place to start https://github.com/promptslab/Awesome-Prompt-Engineering. If you're focusing directly on OpenAI's models then the OpenAI Prompt Engineering Guide would be my recommendation https://help.openai.com/en/articles/6654000-best-practices-for-prompt-engineering-with-openai-api.
Project mention: 📚 Tutorials & 🎨 AI Art Generation Tool List Mega Thread | /r/AI_Aesthetics | 2023-07-26VQGAN-CLIP
Code: https://github.com/omerbt/TokenFlow
Project mention: Google's StyleDrop can transfer style from a single image | /r/StableDiffusion | 2023-06-03If google doesnt, someone like lucidrains probably would implement it, just like he did for imagen and muse.
Project mention: Do you guys recommend any GPU cloud hosting services for stable diffusion? | /r/StableDiffusion | 2023-04-30Honestly though, you’re being a bit paranoid about it. Running your own local install would be much easier, and if you use .safetensors then from my understanding you’re pretty safe. You could also run it using the Docker container for a bit more security, though imo it’s not worth the headache.
This vision is in line with EleutherAI, a non-profit organization founded in July 2020 by a group of researchers. Driven by the perceived opacity and the challenge of reproducibility in AI, their goal was to create leading open-source language models.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python text-to-image related posts
- Are you looking for free open source alternative to Midjourney and Bing images?
- 100% free Midjourney alternative. Plant trees as you generated realistic images
- Are you looking for a green yet free Chatgpt4 Alternative?
- A green tree planting alternative for chatgpt4, Gemini-pro and Midjourney
- Green Chatgt4 Alternative That Plants Trees for Every Chat
- Transforming the Future of Generative AI with Open Access and Global Impact
- 📚 Tutorials & 🎨 AI Art Generation Tool List Mega Thread
-
A note from our sponsor - SaaSHub
www.saashub.com | 26 Apr 2024
Index
What are some of the best open-source text-to-image projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | DALLE2-pytorch | 10,812 |
| 2 | imagen-pytorch | 7,780 |
| 3 | DALLE-pytorch | 5,492 |
| 4 | deep-daze | 4,379 |
| 5 | min-dalle | 3,474 |
| 6 | Awesome-Prompt-Engineering | 3,196 |
| 7 | VQGAN-CLIP | 2,563 |
| 8 | big-sleep | 2,548 |
| 9 | CogView | 1,593 |
| 10 | TokenFlow | 1,462 |
| 11 | Radiata | 984 |
| 12 | text2room | 971 |
| 13 | CogView2 | 914 |
| 14 | muse-maskgit-pytorch | 813 |
| 15 | aphantasia | 768 |
| 16 | stable-diffusion-docker | 712 |
| 17 | Lora-for-Diffusers | 697 |
| 18 | cycle-diffusion | 513 |
| 19 | parti-pytorch | 506 |
| 20 | storyteller | 468 |
| 21 | clip-guided-diffusion | 440 |
| 22 | DALLE-mtf | 435 |
| 23 | Text-to-Image-Synthesis | 389 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com