Python text-to-video

Open-source Python projects categorized as text-to-video
Edit details
Topics: Deep Learning Artificial intelligence video-generation text-to-image stable-diffusion
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
Sponsored

Top 18 Python text-to-video Projects

  • imagen-pytorch

    Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

    • Project mention: Google's StyleDrop can transfer style from a single image | /r/StableDiffusion | 2023-06-03

    If google doesnt, someone like lucidrains probably would implement it, just like he did for imagen and muse.

  • VideoCrafter

    VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models

    • Project mention: GitHub - AILab-CVC/VideoCrafter: VideoCrafter1: Open Diffusion Models for High-Quality Video Generation | /r/StableDiffusion | 2023-10-21

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • Awesome-Prompt-Engineering

    This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc

    • Project mention: AI lessons | /r/ChatGPT | 2023-05-09

    Yes, there are a lot of different resources online, especially for generative AI. The Awesome Prompt Engineering github is probably a good place to start https://github.com/promptslab/Awesome-Prompt-Engineering. If you're focusing directly on OpenAI's models then the OpenAI Prompt Engineering Guide would be my recommendation https://help.openai.com/en/articles/6654000-best-practices-for-prompt-engineering-with-openai-api.

  • make-a-video-pytorch

    Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

  • TokenFlow

    Official Pytorch Implementation for "TokenFlow: Consistent Diffusion Features for Consistent Video Editing" presenting "TokenFlow" (ICLR 2024)

    • Project mention: TokenFlow has been Released | /r/StableDiffusion | 2023-09-07

    Code: https://github.com/omerbt/TokenFlow

  • video-diffusion-pytorch

    Implementation of Video Diffusion Models, Jonathan Ho's new paper extending DDPMs to Video Generation - in Pytorch

  • aphantasia

    CLIP + FFT/DWT/RGB = text to image/video

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • phenaki-pytorch

    Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch

  • MotionDirector

    MotionDirector: Motion Customization of Text-to-Video Diffusion Models.

    • Project mention: List of Stable Diffusion research softwares that I don't think gotten widespread adoption. | /r/StableDiffusion | 2023-12-10

  • nuwa-pytorch

    Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

  • storyteller

    Multimodal AI Story Teller, built with Stable Diffusion, GPT, and neural text-to-speech (by jaketae)

  • Text2Video

    ICASSP 2022: "Text2Video: text-driven talking-head video synthesis with phonetic dictionary".

  • LAMP

    Official implement code of LAMP: Learn a Motion Pattern by Few-Shot Tuning a Text-to-Image Diffusion Model (Few-shot-based text-to-video diffusion)

    • Project mention: List of Stable Diffusion research softwares that I don't think gotten widespread adoption. | /r/StableDiffusion | 2023-12-10

  • KandinskyVideo

    KandinskyVideo — multilingual end-to-end text2video latent diffusion model

    • Project mention: KandinskyVideo — third OS text2video model released in the last few days | /r/StableDiffusion | 2023-11-24

  • Video-Motion-Customization

    VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models (CVPR 2024)

    • Project mention: Code for video motion customization has been released! | /r/StableDiffusion | 2023-12-08

  • ez-text2video

    Easily run text-to-video diffusion with customized video length, fps, and dimensions on 4GB video cards or on CPU.

  • ReuseAndDiffuse

    Reuse and Diffuse: Iterative Denoising for Text-to-Video Generation

    • Project mention: Reuse and Diffuse: Creating More Video Frames from Few with 'VidRD' | /r/StableDiffusion | 2023-10-18

    Code: https://github.com/anonymous0x233/ReuseAndDiffuse

  • ssebowa

    Ssebowa is free and open source library in Python that provides generative-ai models.

    • Project mention: Are you looking for free open source alternative to Midjourney and Bing images? | news.ycombinator.com | 2024-03-25

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python text-to-video related posts

Index

What are some of the best open-source text-to-video projects in Python? This list will help you:

Project Stars
1 imagen-pytorch 7,780
2 VideoCrafter 4,065
3 Awesome-Prompt-Engineering 3,196
4 make-a-video-pytorch 1,839
5 TokenFlow 1,462
6 video-diffusion-pytorch 1,121
7 aphantasia 769
8 phenaki-pytorch 712
9 MotionDirector 687
10 nuwa-pytorch 533
11 storyteller 468
12 Text2Video 408
13 LAMP 220
14 KandinskyVideo 142
15 Video-Motion-Customization 116
16 ez-text2video 92
17 ReuseAndDiffuse 35
18 ssebowa 13

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com