NUWA
CogVideo
Our great sponsors
NUWA | CogVideo | |
---|---|---|
23 | 39 | |
2,794 | 3,480 | |
0.4% | 2.1% | |
3.3 | 2.4 | |
11 months ago | 10 months ago | |
Python | ||
- | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
NUWA
-
How long until we can create full length movies in ai ?
Github: https://github.com/microsoft/NUWA/tree/main/assets/nuwa_infinity/animation
- [D] Most Popular AI Research July 2022 pt. 2 - Ranked Based On GitHub Stars
- Most Popular AI Research July 2022 pt. 2 - Ranked Based On GitHub Stars
-
I'm building a timeline for generative image ML models. What's missing?
Microsoft NUWA: https://github.com/microsoft/NUWA
-
With so many new Text to Image "AI" emerging lately, is it not crazy to speculate about Text to Video?
Microsoft NUWA
-
Have any researchers in the field discussed anything about the prospect of 'text-to-video' - something that's a bit like DALL-E 2, but with a video as the finished output?
NÜWA from Microsoft.
-
Imagine this: complete "fake AI people" are coming, and you didn't even see this coming!
P.S., Lucidrains remade it! AND he's adding an audio transformer to it tomorrow he says! But he needs feedback and someone to train it, I don't think there is enough resources helping this project's training. You can reach him through: https://github.com/microsoft/NUWA
-
NÜWA - text to image
(from here)
CogVideo
-
InstructPix2Pix Video: "Turn the wave into trash"
Additionally two open source demo models [CogVideo[(https://github.com/THUDM/CogVideo) by a groups of cs students a model by [Antonia Antonova](https://antonia.space/text-to-video-generation) and have presented their own innovative methods of generating video from text
-
Effortpost: The Future Of Media Synthesis and AI Art
The second thing that will happen is the appearance of AI video and audio. Google has shown two programs for video generation, one which is fairly high quality and the other which can make long videos with several scenes. Meta has also demonstrated their own. We've already seen other projects like CogVideo, as well as many others that are currently being worked on. It's likely that these techniques will become so refined that over the next year or two, they'll have a similar boom to image generation programs. And eventually, they'll have a similar application in video editing, once coherence is adequate enough. Select a person's shirt, and it stays that for the remainder of the scene. Change an actor's hairstyle in real time, or add characters that didn't exist into a scene and let the computer figure out the desired level of realism. This'll revolutionize VFX to a degree where making an effects heavy will be less about wrangling complex toolsets and more about making aesthetic choices of style and placement.
- AI Content Generation, Part 1: Machine Learning Basics
- Can we please make a general update on all the "most important" news/repos available?
-
Stable Diffusion Public Release – Stability.ai
Check out https://github.com/THUDM/CogVideo - progress is being made on coherent video generation.
Characters and dialogue are effectively solved, just look at GPT-3.
The entity behind StableDiffusion is also supporting generative music art, so let's see what is coming out of that: https://www.harmonai.org/
We are currently far away from generating a production quality movie with AI, but I don't think it's going to be nearly as long as a lifetime. In my opinion, we'll have high quality AI shorts within the decade.
-
Does training transformers on large corpuses of music files have some hidden difficulty which makes it impossible?
A better comparison to AI music generation would be video generation, which has not improved much since i saw first examples some years ago. The last iteration is stuff like CogVideo and this is only able to generate 4 second videos with mid-strong artifacts.
-
With the rise of AI will art careers be viable?
I may be misunderstanding either what you are saying, or what is being presented, but is this not temporally coherent text to video generation?
- Show HN: I stripped DALL·E Mini to its bare essentials and converted it to Torch
-
With so many new Text to Image "AI" emerging lately, is it not crazy to speculate about Text to Video?
CogVideo (code and model will be released "in the near future" per this issue).
What are some alternatives?
stable-diffusion-ui - Easiest 1-click way to install and use Stable Diffusion on your computer. Provides a browser UI for generating images from text prompts and images. Just enter your text prompt, and see the generated image. [Moved to: https://github.com/easydiffusion/easydiffusion]
dalle-playground - A playground to generate images from any text prompt using Stable Diffusion (past: using DALL-E Mini)
stable-diffusion - Optimized Stable Diffusion modified to run on lower GPU VRAM
stable-diffusion-webui-feature-showcase - Feature showcase for stable-diffusion-webui
stable-diffusion - A latent text-to-image diffusion model
imagen-pytorch - Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
stable-diffusion-webui - Stable Diffusion web UI
diffusers - 🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
min-dalle - min(DALL·E) is a fast, minimal port of DALL·E Mini to PyTorch
DALLE2-pytorch - Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch
stable-diffusion-webui - Stable Diffusion web UI [Moved to: https://github.com/Sygil-Dev/sygil-webui]
DALLE2-video - Direct application of DALLE-2 to video synthesis, using factored space-time Unet and Transformers