Music visualisation + stable diffusion + lots of animation parameter tweaking (method in comments)

This page summarizes the projects mentioned and recommended in the original post on /r/StableDiffusion

Our great sponsors
  • SurveyJS - Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • stable-diffusion-webui

    Stable Diffusion web UI

  • A1111

  • deforum-for-automatic1111-webui

    Discontinued Deforum extension script for AUTOMATIC1111's Stable Diffusion webui [Moved to: https://github.com/deforum-art/sd-webui-deforum]

  • Deforum extension for A1111, using the Parseq integration branch, modified to allow 3D warping when using video for input frames (each input frame is a 75/25 blend of 75% video frame + 25% img2img loopback, fed through warping). NB: doing 3D warping on the input video is a bad idea. If you’re curious, you can see my hacks to enable it here, but I’m not going to polish it or raise a PR for it: it creates a clash between the motion in the video and the motion applied by the warping. For my particular usecase, where chaotic and abstract is the goal, it’s sort of fun, but it’s not a real solution for anything practical.

  • SurveyJS

    Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

    SurveyJS logo
  • butterchurn

    Butterchurn is a WebGL implementation of the Milkdrop Visualizer

  • The input video was screen recorded from https://butterchurnviz.com/, using preset "martin - witchcraft reloaded".

  • sd-parseq

    Parameter sequencer for Stable Diffusion

  • sd-parseq for parameter control / keyframing.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts