text-to-video

Top 23 text-to-video Open-Source Projects

  • imagen-pytorch

    Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

  • Project mention: Google's StyleDrop can transfer style from a single image | /r/StableDiffusion | 2023-06-03

    If google doesnt, someone like lucidrains probably would implement it, just like he did for imagen and muse.

  • VideoCrafter

    VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models

  • Project mention: GitHub - AILab-CVC/VideoCrafter: VideoCrafter1: Open Diffusion Models for High-Quality Video Generation | /r/StableDiffusion | 2023-10-21
  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • Awesome-Prompt-Engineering

    This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc

  • Project mention: AI lessons | /r/ChatGPT | 2023-05-09

    Yes, there are a lot of different resources online, especially for generative AI. The Awesome Prompt Engineering github is probably a good place to start https://github.com/promptslab/Awesome-Prompt-Engineering. If you're focusing directly on OpenAI's models then the OpenAI Prompt Engineering Guide would be my recommendation https://help.openai.com/en/articles/6654000-best-practices-for-prompt-engineering-with-openai-api.

  • Awesome-Video-Diffusion

    A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.

  • make-a-video-pytorch

    Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

  • TokenFlow

    Official Pytorch Implementation for "TokenFlow: Consistent Diffusion Features for Consistent Video Editing" presenting "TokenFlow" (ICLR 2024)

  • Project mention: TokenFlow has been Released | /r/StableDiffusion | 2023-09-07

    Code: https://github.com/omerbt/TokenFlow

  • text-to-video-synthesis-colab

    Text To Video Synthesis Colab

  • Project mention: Text-to-Video-Synthesis-Colab | news.ycombinator.com | 2023-07-24
  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • video-diffusion-pytorch

    Implementation of Video Diffusion Models, Jonathan Ho's new paper extending DDPMs to Video Generation - in Pytorch

  • aphantasia

    CLIP + FFT/DWT/RGB = text to image/video

  • phenaki-pytorch

    Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch

  • MotionDirector

    MotionDirector: Motion Customization of Text-to-Video Diffusion Models.

  • Project mention: List of Stable Diffusion research softwares that I don't think gotten widespread adoption. | /r/StableDiffusion | 2023-12-10
  • nuwa-pytorch

    Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

  • storyteller

    Multimodal AI Story Teller, built with Stable Diffusion, GPT, and neural text-to-speech (by jaketae)

  • Text2Video

    ICASSP 2022: "Text2Video: text-driven talking-head video synthesis with phonetic dictionary".

  • VBench

    [CVPR2024 Highlight] VBench - We Evaluate Video Generation

  • Project mention: CVPR 2024 Datasets and Benchmarks - Part 2: Benchmarks | dev.to | 2024-04-30

    GitHub

  • Gen-L-Video

    The official implementation for "Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoising".

  • Project mention: GenL test - Clowns on Mars | /r/StableDiffusion | 2023-06-23
  • LAMP

    Official implement code of LAMP: Learn a Motion Pattern by Few-Shot Tuning a Text-to-Image Diffusion Model (Few-shot-based text-to-video diffusion)

  • Project mention: List of Stable Diffusion research softwares that I don't think gotten widespread adoption. | /r/StableDiffusion | 2023-12-10
  • SoraFlows

    The most powerful and modular Sora WebUI, api and backend with OpenAI's Sora Model. Collecting the highest quality prompts for Sora. using NextJs and Tailwind CSS

  • KandinskyVideo

    KandinskyVideo — multilingual end-to-end text2video latent diffusion model

  • Project mention: KandinskyVideo — third OS text2video model released in the last few days | /r/StableDiffusion | 2023-11-24
  • Video-Motion-Customization

    VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models (CVPR 2024)

  • Project mention: Code for video motion customization has been released! | /r/StableDiffusion | 2023-12-08
  • ez-text2video

    Easily run text-to-video diffusion with customized video length, fps, and dimensions on 4GB video cards or on CPU.

  • anima

    Turn text into video using Stable Diffusion and Google FILM (by saharmor)

  • ReuseAndDiffuse

    Reuse and Diffuse: Iterative Denoising for Text-to-Video Generation

  • Project mention: Reuse and Diffuse: Creating More Video Frames from Few with 'VidRD' | /r/StableDiffusion | 2023-10-18

    Code: https://github.com/anonymous0x233/ReuseAndDiffuse

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

text-to-video related posts

  • Are you looking for free open source alternative to Midjourney and Bing images?

    1 project | news.ycombinator.com | 25 Mar 2024
  • 100% free Midjourney alternative. Plant trees as you generated realistic images

    1 project | news.ycombinator.com | 20 Mar 2024
  • Are you looking for a green yet free Chatgpt4 Alternative?

    1 project | news.ycombinator.com | 18 Mar 2024
  • A green tree planting alternative for chatgpt4, Gemini-pro and Midjourney

    1 project | news.ycombinator.com | 14 Mar 2024
  • Green Chatgt4 Alternative That Plants Trees for Every Chat

    1 project | news.ycombinator.com | 14 Mar 2024
  • Transforming the Future of Generative AI with Open Access and Global Impact

    1 project | news.ycombinator.com | 14 Mar 2024
  • Code for video motion customization has been released!

    1 project | /r/StableDiffusion | 8 Dec 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 5 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source text-to-video projects? This list will help you:

Project Stars
1 imagen-pytorch 7,787
2 VideoCrafter 4,083
3 Awesome-Prompt-Engineering 3,212
4 Awesome-Video-Diffusion 2,451
5 make-a-video-pytorch 1,840
6 TokenFlow 1,468
7 text-to-video-synthesis-colab 1,386
8 video-diffusion-pytorch 1,125
9 aphantasia 769
10 phenaki-pytorch 715
11 MotionDirector 696
12 nuwa-pytorch 533
13 storyteller 472
14 Text2Video 409
15 VBench 286
16 Gen-L-Video 260
17 LAMP 223
18 SoraFlows 182
19 KandinskyVideo 143
20 Video-Motion-Customization 117
21 ez-text2video 92
22 anima 40
23 ReuseAndDiffuse 35

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com