The Flight Making Of

10 days ago
14

Another variation of an existing Comfy workflow, this time from the remarkable @visualfrisson This is a modified workflow that reads a video clip or a folder with images in it and then uses the Qwen VL tools to spit out a list of textual descriptions of each shot (user specified frame count between shots) which is then in turn submitted to Midjourney to generate new keyframes using that text info. This is then run through the comfyui workflow but I've modified it to use a for loop to generate a user specified duration for each clip (17 frames in this case) and to load a randomly selected frame from the folder holding all the Midjourney keyframes and run that frame through WAN animate all looped repeatedly for the full duration of the reference motion video. The result is a single workflow that generates the entire video in one go, featuring all Midjourney keyframes cut sequentially to all 1730 frames/101 clips of the incredible dance routine clip by @xojuliashea. Check it out. Purely for dev purposes no commercial purpose. Music track created with @sunomusic #comfyui

Loading comments...