CogVideo
stable-diffusion-webui
Our great sponsors
CogVideo | stable-diffusion-webui | |
---|---|---|
39 | 104 | |
3,493 | 5,487 | |
2.4% | - | |
2.4 | 10.0 | |
11 months ago | over 1 year ago | |
Python | Python | |
Apache License 2.0 | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
CogVideo
-
InstructPix2Pix Video: "Turn the wave into trash"
Additionally two open source demo models [CogVideo[(https://github.com/THUDM/CogVideo) by a groups of cs students a model by [Antonia Antonova](https://antonia.space/text-to-video-generation) and have presented their own innovative methods of generating video from text
-
Effortpost: The Future Of Media Synthesis and AI Art
The second thing that will happen is the appearance of AI video and audio. Google has shown two programs for video generation, one which is fairly high quality and the other which can make long videos with several scenes. Meta has also demonstrated their own. We've already seen other projects like CogVideo, as well as many others that are currently being worked on. It's likely that these techniques will become so refined that over the next year or two, they'll have a similar boom to image generation programs. And eventually, they'll have a similar application in video editing, once coherence is adequate enough. Select a person's shirt, and it stays that for the remainder of the scene. Change an actor's hairstyle in real time, or add characters that didn't exist into a scene and let the computer figure out the desired level of realism. This'll revolutionize VFX to a degree where making an effects heavy will be less about wrangling complex toolsets and more about making aesthetic choices of style and placement.
- AI Content Generation, Part 1: Machine Learning Basics
- Can we please make a general update on all the "most important" news/repos available?
-
Stable Diffusion Public Release – Stability.ai
Check out https://github.com/THUDM/CogVideo - progress is being made on coherent video generation.
Characters and dialogue are effectively solved, just look at GPT-3.
The entity behind StableDiffusion is also supporting generative music art, so let's see what is coming out of that: https://www.harmonai.org/
We are currently far away from generating a production quality movie with AI, but I don't think it's going to be nearly as long as a lifetime. In my opinion, we'll have high quality AI shorts within the decade.
-
How far away are we from have AI like DALL-E 2 be able to create other media like 3d models or video?
CogVideo and a CogView web app.
-
Does training transformers on large corpuses of music files have some hidden difficulty which makes it impossible?
A better comparison to AI music generation would be video generation, which has not improved much since i saw first examples some years ago. The last iteration is stuff like CogVideo and this is only able to generate 4 second videos with mid-strong artifacts.
-
[R] CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers + Gradio Web Demo
github: https://github.com/THUDM/CogVideo
- CogVideo: Code and 94B Model for Text-to-Video Generation via Transformers
-
CogVideo (text-to-video) model, code, and demo are available
GitHub repo.
stable-diffusion-webui
-
[Stable Diffusion] Je suis confus Aide? - Comment utilisez-vous LDSR avec SD-Webui?
[https://github.com/sd-webui/stable-diffusion-webui/wiki/installation de numéro(https://github.com/sd-webui/stable-diffusion-webui/wiki/installation)
-
[Stable Diffusion] Quelle est la meilleure interface graphique à installer sur Windows?
https://github.com/sd-webui/stable-diffusion-webui (prend beaucoup à installer)
- Daily General Discussion - October 21, 2022
-
Most popular IA to animate?
you can "animate" with stable diffusion usining text to video https://github.com/nateraw/stable-diffusion-videos or https://github.com/sd-webui/stable-diffusion-webui
-
Automatic1111 removed from pinned guide.
I mentioned Automatic1111 on SD-WEBUI and they deleted the comment. I guess this is why. My installation failed on SD-WEBUI and there was no solution for me. I suspect that's why Automatic1111's fork is so popular. He went above and beyond to make sure people with 1660ti's could run SD flawlessly with all the different tools available.
-
.pt to .ckpt
Any way to convert a .pt model to a .ckpt model? Stable-diffusion-webui only seems to support the second type of file but just renaming them does not work:
-
Flooded district by AI
This is Stable-Diffusion. Here is a UI version https://github.com/sd-webui/stable-diffusion-webui
-
AI image generated using the prompt "Streets of Dunwall"
I dunno about the app. I use this https://github.com/sd-webui/stable-diffusion-webui it's very resource hungry though.
-
NMKD Stable Diffusion GUI 1.5.0 is out! Now with exclusion words, CodeFormer face restoration, model merging and pruning tool, even lower VRAM requirements (4 GB), and a ton of quality-of-life improvements. Details in comments.
Haven't tried this GUI yet. Can anyone chime in about how it compares to Automatic1111's and sd-webui/HLKY's? There are so many good repos out there that it's getting hard to keep track of them all
-
Someone just joined 11 GPUs to the Stable Horde. I just tested: 20 gens @ 1024x1024x50 in 2 minutes! All for free!
Maybe those who joined were not aware that they joined the horde :-)
What are some alternatives?
stable-diffusion-ui - Easiest 1-click way to install and use Stable Diffusion on your computer. Provides a browser UI for generating images from text prompts and images. Just enter your text prompt, and see the generated image. [Moved to: https://github.com/easydiffusion/easydiffusion]
diffusers-uncensored - Uncensored fork of diffusers
dalle-playground - A playground to generate images from any text prompt using Stable Diffusion (past: using DALL-E Mini)
onnx - Open standard for machine learning interoperability
stable-diffusion - Optimized Stable Diffusion modified to run on lower GPU VRAM
stable-diffusion-webui - Stable Diffusion web UI
stable-diffusion-webui-feature-showcase - Feature showcase for stable-diffusion-webui
rocm-build - build scripts for ROCm
stable-diffusion - A latent text-to-image diffusion model
Dreambooth-Stable-Diffusion - Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) by way of Textual Inversion (https://arxiv.org/abs/2208.01618) for Stable Diffusion (https://arxiv.org/abs/2112.10752). Tweaks focused on training faces, objects, and styles.
imagen-pytorch - Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
waifu-diffusion - stable diffusion finetuned on weeb stuff