CogVideo VS glid-3-xl-stable

Additionally two open source demo models [CogVideo[(https://github.com/THUDM/CogVideo) by a groups of cs students a model by [Antonia Antonova](https://antonia.space/text-to-video-generation) and have presented their own innovative methods of generating video from text

The second thing that will happen is the appearance of AI video and audio. Google has shown two programs for video generation, one which is fairly high quality and the other which can make long videos with several scenes. Meta has also demonstrated their own. We've already seen other projects like CogVideo, as well as many others that are currently being worked on. It's likely that these techniques will become so refined that over the next year or two, they'll have a similar boom to image generation programs. And eventually, they'll have a similar application in video editing, once coherence is adequate enough. Select a person's shirt, and it stays that for the remainder of the scene. Change an actor's hairstyle in real time, or add characters that didn't exist into a scene and let the computer figure out the desired level of realism. This'll revolutionize VFX to a degree where making an effects heavy will be less about wrangling complex toolsets and more about making aesthetic choices of style and placement.

Check out https://github.com/THUDM/CogVideo - progress is being made on coherent video generation.

Characters and dialogue are effectively solved, just look at GPT-3.

The entity behind StableDiffusion is also supporting generative music art, so let's see what is coming out of that: https://www.harmonai.org/

We are currently far away from generating a production quality movie with AI, but I don't think it's going to be nearly as long as a lifetime. In my opinion, we'll have high quality AI shorts within the decade.

CogVideo and a CogView web app.

A better comparison to AI music generation would be video generation, which has not improved much since i saw first examples some years ago. The last iteration is stuff like CogVideo and this is only able to generate 4 second videos with mid-strong artifacts.

github: https://github.com/THUDM/CogVideo

GitHub repo.

I don't know how you can say this but it's completely different than anything we had before, the only exception was https://github.com/Jack000/glid-3-xl-stable/wiki/Custom-inpainting-model, this model was a finituned version of v1.4 but not having a separate channel for the original image and the mask makes it weaker.

Check out the item by lkwq007 in this list https://www.reddit.com/r/StableDiffusion/comments/wqaizj/list_of_stable_diffusion_systems/ , and also the model for this web app https://replicate.com/devxpy/glid-3-xl-stable , which I believe is this https://github.com/Jack000/glid-3-xl-stable .

Right now I am using different, better optimized model for just outpaiting/inpating using this https://github.com/Jack000/glid-3-xl-stable as base

I'm using a slightly modified and optimized version of https://github.com/Jack000/glid-3-xl-stable for inpainting/outpainting.

For this editor we've integrated Jack Qiao's excellent custom inpainting model from the glid-3-xl-sd project instead. This is a fine-tuned version of Stable Diffusion with significantly better inpainting capabilities than standard SD. You can read more about how it works here along with comparison images between it and regular SD.

you cant. they are different architectures: https://github.com/Jack000/glid-3-xl-stable/issues/17

I am wondering tho, if this one uses https://github.com/Jack000/glid-3-xl-stable/wiki/Custom-inpainting-model glid-3 inpainting?

(also check this custom SD inpainting/outpainting model, it's easily the best i've seen https://github.com/Jack000/glid-3-xl-stable/wiki/Custom-inpainting-model)