CogVideo
dalle-playground
CogVideo | dalle-playground | |
---|---|---|
39 | 35 | |
3,512 | 2,762 | |
1.6% | - | |
2.4 | 3.2 | |
11 months ago | 5 months ago | |
Python | JavaScript | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
CogVideo
-
InstructPix2Pix Video: "Turn the wave into trash"
Additionally two open source demo models [CogVideo[(https://github.com/THUDM/CogVideo) by a groups of cs students a model by [Antonia Antonova](https://antonia.space/text-to-video-generation) and have presented their own innovative methods of generating video from text
-
Effortpost: The Future Of Media Synthesis and AI Art
The second thing that will happen is the appearance of AI video and audio. Google has shown two programs for video generation, one which is fairly high quality and the other which can make long videos with several scenes. Meta has also demonstrated their own. We've already seen other projects like CogVideo, as well as many others that are currently being worked on. It's likely that these techniques will become so refined that over the next year or two, they'll have a similar boom to image generation programs. And eventually, they'll have a similar application in video editing, once coherence is adequate enough. Select a person's shirt, and it stays that for the remainder of the scene. Change an actor's hairstyle in real time, or add characters that didn't exist into a scene and let the computer figure out the desired level of realism. This'll revolutionize VFX to a degree where making an effects heavy will be less about wrangling complex toolsets and more about making aesthetic choices of style and placement.
- AI Content Generation, Part 1: Machine Learning Basics
- Can we please make a general update on all the "most important" news/repos available?
-
Stable Diffusion Public Release – Stability.ai
Check out https://github.com/THUDM/CogVideo - progress is being made on coherent video generation.
Characters and dialogue are effectively solved, just look at GPT-3.
The entity behind StableDiffusion is also supporting generative music art, so let's see what is coming out of that: https://www.harmonai.org/
We are currently far away from generating a production quality movie with AI, but I don't think it's going to be nearly as long as a lifetime. In my opinion, we'll have high quality AI shorts within the decade.
-
How far away are we from have AI like DALL-E 2 be able to create other media like 3d models or video?
CogVideo and a CogView web app.
-
Does training transformers on large corpuses of music files have some hidden difficulty which makes it impossible?
A better comparison to AI music generation would be video generation, which has not improved much since i saw first examples some years ago. The last iteration is stuff like CogVideo and this is only able to generate 4 second videos with mid-strong artifacts.
-
[R] CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers + Gradio Web Demo
github: https://github.com/THUDM/CogVideo
- CogVideo: Code and 94B Model for Text-to-Video Generation via Transformers
-
CogVideo (text-to-video) model, code, and demo are available
GitHub repo.
dalle-playground
-
Discord bot with a locally-hosted SD backend.
Built on dalle-playground because it is simple and I like it.
- Neural photo engine with Intel compute stick?
-
Free/open-source AI Text-To-Image Models that can be run on AWS?
[1] https://github.com/saharmor/dalle-playground
- ai_irl
-
Running Dall-e mini on Windows? (Or: Are there any equivalent text-to-image AI's I can run on a windows PC with a 2080 TI?)
If you decide to abandon the idea of running locally and want to run in the cloud instead, https://github.com/saharmor/dalle-playground has a Google Colab notebook that's relatively easy to run (although Google Colab's free tier is relatively limited).
-
Run Your Own DALL·E Mini (Craiyon) Server on EC2
Next, we want the code in the https://github.com/hrichardlee/dalle-playground repo, and we want to construct a pip environment from the backend/requirements.txt file in that repo. We were almost able to use the saharmor/dalle-playground repo as-is, but we had to make one change to add the jax[cuda] package to the requirements.txt file. In case you haven’t seen jax before, jax is a machine-learning library from Google, roughly equivalent to Tensorflow or PyTorch. It combines Autograd for automatic differentiation and XLA (accelerated linear algebra) for JIT-compiling numpy-like code for Google’s TPUs or Nvidia’s CUDA API for GPUs. The CUDA support requires explicitly selecting the [cuda] option when we install the package.
- Dream's over guys...
-
How to run DALLE-2 locally
Is their any way to run DALLE-2 inside of a docker container similarly to this DALLE-PLAYGROUND repo on github?
-
How difficult would it be to set up your own DALL-E (mini/mega) API for side-projects?
I know there are open source projects like dalle-playground. Would it literally be enough to host this app on an EC2 instance with the mini model?
- an AI image generator capable of taking a prompt and making it come to life.
What are some alternatives?
stable-diffusion-ui - Easiest 1-click way to install and use Stable Diffusion on your computer. Provides a browser UI for generating images from text prompts and images. Just enter your text prompt, and see the generated image. [Moved to: https://github.com/easydiffusion/easydiffusion]
dalle-mini - DALL·E Mini - Generate images from a text prompt
stable-diffusion - Optimized Stable Diffusion modified to run on lower GPU VRAM
Dannjs - Easy to use Deep Neural Network Library for JavaScript.
stable-diffusion-webui-feature-showcase - Feature showcase for stable-diffusion-webui
min-dalle - min(DALL·E) is a fast, minimal port of DALL·E Mini to PyTorch
stable-diffusion - A latent text-to-image diffusion model
nano-neuron - 🤖 NanoNeuron is 7 simple JavaScript functions that will give you a feeling of how machines can actually "learn"
imagen-pytorch - Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
pollinations - Generate Art
NUWA - A unified 3D Transformer Pipeline for visual synthesis
AI-Expert-Roadmap - Roadmap to becoming an Artificial Intelligence Expert in 2022