sd-webui-modelscope-text2video
VideoCrafter
sd-webui-modelscope-text2video | VideoCrafter | |
---|---|---|
17 | 6 | |
479 | 4,101 | |
- | 3.5% | |
10.0 | 7.4 | |
about 1 year ago | about 2 months ago | |
Python | Python | |
Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sd-webui-modelscope-text2video
-
New 1.2B parameter text to video model is out, higher quality than modelscope
Working on it https://github.com/deforum-art/sd-webui-modelscope-text2video/pull/96 (also, will rename the repo to just sd-webui-text2video after that)
- This is fine
-
Can someone help me understand what happens with VRAM?
They're linked from the main project's REDME.md under the "Where to get the weights" heading. (https://github.com/deforum-art/sd-webui-modelscope-text2video)
- Trump VS Godzilla - ModelScope + Img2Img
- I'm the creator of LoRA. How can I make it better?
-
"Melting World" - Text To Video
Workflow: Text to video AUTO1111 extension https://github.com/deforum-art/sd-webui-modelscope-text2video
-
Wake up, samurai! ModelScope text2video fine-tuning repo just dropped! Based on Diffusers, requirements start from GTX 3090 at the moment
Please, give it a try and leave your feedback. Soon fine-tuned models are planned to be usable in the Auto1111 plugin https://github.com/deforum-art/sd-webui-modelscope-text2video/issues/48 as well
-
ModelScope text2video is reported to be running at 4 GBs of VRAM with enough effort — still, help needed to bring more optimizations and streamline the process
Meanwhile, if you have good training vids, it'd be nice to collect them somewhere for the future training, like inside the extension repo's Discussions https://github.com/deforum-art/sd-webui-modelscope-text2video/discussions
- The kind of result I'm getting with the new A1111 MS text2video model on a RTX 3060 (12 GB)
-
"The Rise Of AI" - Text To Video Short Film
Workflow: Text to video AUTO1111 extension https://github.com/deforum-art/sd-webui-modelscope-text2video
VideoCrafter
- GitHub - AILab-CVC/VideoCrafter: VideoCrafter1: Open Diffusion Models for High-Quality Video Generation
-
Tools For AI Animation and Filmmaking , Community Rules, ect. (**FAQ**)
Video Crafter (Generate 8-second vidoes using a text prompt) https://github.com/VideoCrafter/VideoCrafter (Video Crafter - GitHub) https://huggingface.co/VideoCrafter/t2v-version-1-1/tree/main/models (Video Crafter Model Checkpoints) -------UPSCALE--------
- Joe Biden vs. Shakira - VideoCrafter (Video2Video)
- VideoCrafter:a Toolkit for Text-to-Video Generation and Editing
- New 1.2B parameter text to video model is out: Latent Video Diffusion Models for High-Fidelity Long Video Generation
-
New 1.2B parameter text to video model is out, higher quality than modelscope
github: https://github.com/VideoCrafter/VideoCrafter
What are some alternatives?
diffusers - 🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
Text-To-Video-Finetuning - Finetune ModelScope's Text To Video model using Diffusers 🧨
sd-webui-additional-networks
sd-webui-deforum - Deforum extension for AUTOMATIC1111's Stable Diffusion webui
stable-diffusion-webui-normalmap-script - Normal Maps for Stable Diffusion WebUI
sd-webui-text2video - Auto1111 extension implementing text2video diffusion models (like ModelScope or VideoCrafter) using only Auto1111 webui dependencies
lora - Using Low-rank adaptation to quickly fine-tune diffusion models.
stable-diffusion - A latent text-to-image diffusion model
modelscope - ModelScope: bring the notion of Model-as-a-Service to life.
stablediffusion - High-Resolution Image Synthesis with Latent Diffusion Models