New Optical Flow Cadence! Deforum Stable Diffusion WebUI
Music from YouTube Audio Library:
“Just Breathing (Instrumental)” - NEFFEX
I recently added a checkbox to the Coherence section of Deforum WebUI for "Optical flow cadence", which changes the behavior of cadence to not only fade between frames while moving the animation, but also using optical flow to warp one frame into the next. Whether to use it is highly dependent on the content you're rendering, but for many things, it can offer a significant boost in rendering times, because cadence works better. This is set on cadence 5, at 30fps. So, it's actually only rendering 6 Stable Diffusion frames per second. The other 24 frames are filled in by Deforum's cadence routines, and now improved with optical flow in this instance. This can provide similar results to something like RIFE, but it isn't directly comparable - and this is much faster. It hardly takes any more time than cadence already took.
I'm also using a very small amount of hybrid video compositing here, but only to help guide the hallucination. Using a Blend mask with comp alpha at 0.05 and blend alpha at 0.05. This basically only allows the video to affect it a little bit when the scene is very dark. Make no mistake though - this is 3D animation. The original video is nothing like this. It's actually this LG video: https://www.youtube.com/watch?v=mkggXE5e2yk
This is also possible now because I fixed the depth stretching bug that had plagued anything but 1:1 videos since the beginning of Deforum. Now, depth warping is consistent, and much more usable.
I'm also using another feature I added, color coherence = Video Input.
I hope you enjoy all the new tools as much as I am enjoying them!
One prompt:
"multi-colored smoke everywhere with beautiful women taking hits from complex glass bong turbo encabulators and blowing out huge clouds of rainbow colored smoke, swirls of smoke around everyone, chambers of bubbling colored liquids, marijuana themed, marijuana posters, head shop background, photography for high times magazine"
#aiart #aiartist #deforum #stablediffusion
🌲⭐🌃
🤜 Forest Star Walz
👉 #reallybigname
https://www.youtube.com/reallybigname
https://www.facebook.com/reallybigname
https://www.instagram.com/reallybigname
https://www.pinterest.com/reallybigname
https://www.twitter.com/reallybigname
https://www.snapchat.com/add/reallybigname
https://www.soundcloud.com/forest-star-walz
-
6:07
reallybigname
1 year agoDeforum Experiment - Hybrid Video Input / 3D Mode by reallybigname - Stable Diffusion
20 -
3:04
reallybigname
1 year agoOptical Flow Cadence for Deforum WebUI - First Video
71 -
24:32
Mike Yeah
8 months agoCreating Optical WORD Illusionary Images with Stable Diffusion and ControlNet AI Tutorial | A1111
121 -
11:53
Talk About News Breaking Video News
1 year ago $0.02 earnedLearn Stable Diffusion 2.0: The New AI Tool for Creating Realistic Images
132 -
6:09:17
MY VIDEOS
10 months agoCONTINUOUS LIVE STREAMING STABLE DIFFUSION DEFORUM AUTOMATIC 1111 VIDEOS
14 -
9:41
What's AI
6 months agoStable Video Diffusion (SVD) by Stability AI Explained
8 -
1:56
Crazy Visuals
1 year agoAi Generated A Music Video WIth Stable Diffusion
3 -
1:03
39 DeZignS
8 months ago(#16) VFX Motion Graphics "Light & Motion Study V1" by 39 DeZignS
324 -
0:19
aiartitsai
1 year agoAI-Animation Created With Deforum Diffusion
-
5:37
What's AI
1 year agoGuiding Stable Diffusion with your Images (An Image is Worth One Word Explained)
18