CogVideo
stable-diffusion-ui
CogVideo | stable-diffusion-ui | |
---|---|---|
39 | 249 | |
3,512 | 6,808 | |
1.6% | - | |
2.4 | 9.9 | |
11 months ago | 11 months ago | |
Python | JavaScript | |
Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
CogVideo
-
InstructPix2Pix Video: "Turn the wave into trash"
Additionally two open source demo models [CogVideo[(https://github.com/THUDM/CogVideo) by a groups of cs students a model by [Antonia Antonova](https://antonia.space/text-to-video-generation) and have presented their own innovative methods of generating video from text
-
Effortpost: The Future Of Media Synthesis and AI Art
The second thing that will happen is the appearance of AI video and audio. Google has shown two programs for video generation, one which is fairly high quality and the other which can make long videos with several scenes. Meta has also demonstrated their own. We've already seen other projects like CogVideo, as well as many others that are currently being worked on. It's likely that these techniques will become so refined that over the next year or two, they'll have a similar boom to image generation programs. And eventually, they'll have a similar application in video editing, once coherence is adequate enough. Select a person's shirt, and it stays that for the remainder of the scene. Change an actor's hairstyle in real time, or add characters that didn't exist into a scene and let the computer figure out the desired level of realism. This'll revolutionize VFX to a degree where making an effects heavy will be less about wrangling complex toolsets and more about making aesthetic choices of style and placement.
- AI Content Generation, Part 1: Machine Learning Basics
- Can we please make a general update on all the "most important" news/repos available?
-
Stable Diffusion Public Release – Stability.ai
Check out https://github.com/THUDM/CogVideo - progress is being made on coherent video generation.
Characters and dialogue are effectively solved, just look at GPT-3.
The entity behind StableDiffusion is also supporting generative music art, so let's see what is coming out of that: https://www.harmonai.org/
We are currently far away from generating a production quality movie with AI, but I don't think it's going to be nearly as long as a lifetime. In my opinion, we'll have high quality AI shorts within the decade.
-
How far away are we from have AI like DALL-E 2 be able to create other media like 3d models or video?
CogVideo and a CogView web app.
-
Does training transformers on large corpuses of music files have some hidden difficulty which makes it impossible?
A better comparison to AI music generation would be video generation, which has not improved much since i saw first examples some years ago. The last iteration is stuff like CogVideo and this is only able to generate 4 second videos with mid-strong artifacts.
-
[R] CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers + Gradio Web Demo
github: https://github.com/THUDM/CogVideo
- CogVideo: Code and 94B Model for Text-to-Video Generation via Transformers
-
CogVideo (text-to-video) model, code, and demo are available
GitHub repo.
stable-diffusion-ui
-
Useful Links
CMDR2's 1-Click Installer
-
Best current stable diffusion UI app?
Hey so i'm currently using easydiffusion but its missing one feature i've been really wanting to play around with recently. Video, and i've heard from some others that its one of the easiest to install but least peformant and worse options you can get; so what do you guys suggest?
-
The softer side of self hosting: The aesthetics, logos
Or just use the CPU and it works, just takes a few minutes. stable diffusion cpu But don't let me stop you, I need one too.
-
So how is nvidia gpu experience these days?
No. CUDA is very straightforward. There is even a nice project that sets up Stable Diffusion for you. With basically no knowledge about AI i was able to get it to run. If i recall correctly i just needed to install one dependency manually, and i was provided with nice web gui for playing with it.
-
Models and samplers…
You could read the guide first: https://github.com/cmdr2/stable-diffusion-ui/wiki/UI-Overview or Start easy diffusion
-
Could someone please make my wife into a realistic sculpture/statue? Will tip $50 for a perfect one!
Thanks and your right there are loads, trying out this from GitHub
- What is the text-to-image AI tool?
-
Tip for a (kinda) newbie
Simplest start https://github.com/cmdr2/stable-diffusion-ui
-
SD privacy? Offline? Concerns?
First is Easy Diffusion, you need to be online just once to run the installer. It downloads several extra files. Let it finish and then make some test pictures. Exit everything (browser window and text window). Then anytime you want to run it, just turn off internet and run the batch file to start it up. No internet!
-
Need help installing SD on AMD!!
Yesterday I got Easy Diffusion to work (on Windows only), but it refuses to use the GPU and instead uses the CPU, which of course, takes nearly an hour to make a 512x512 image.
What are some alternatives?
dalle-playground - A playground to generate images from any text prompt using Stable Diffusion (past: using DALL-E Mini)
stable-diffusion-webui - Stable Diffusion web UI
stable-diffusion - Optimized Stable Diffusion modified to run on lower GPU VRAM
ComfyUI - The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.
stable-diffusion-webui-feature-showcase - Feature showcase for stable-diffusion-webui
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
stable-diffusion - A latent text-to-image diffusion model
A1111-Web-UI-Installer - Complete installer for Automatic1111's infamous Stable Diffusion WebUI
imagen-pytorch - Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
civitai - A repository of models, textual inversions, and more
NUWA - A unified 3D Transformer Pipeline for visual synthesis
SHARK - SHARK - High Performance Machine Learning Distribution