I asked AI to make a music video for Infected Mushroom

1 year ago
441

I used a variety of AI models to create a music video for the track Bliss on Mushrooms (feat. Miyavi), by Infected Mushroom & Bliss. The exciting part about working with AI models to produce visuals is that the technology is advancing at such a breakneck speed, new tools are coming out faster than I can keep up. This is the first time I've been able to use Dalle2 and Stable-Diffusion, and like many others in the AI art space, I've been OBSESSED. We are living in the future and it feels like magic that I'm just one person and I'm able to do this with the resources available. It isn't magic though, it's thanks to the amazing and selfless contributions of the open source community.

What parts are done by me vs the AI? Just like in my previous AI generated video using Disco Diffusion, I am manually keyframing many elements to sync up with the music. The camera motion, video inputs, cuts, noise and strength scheduling, etc, are all still controlled by me. We are still not at the point where I can input a song, press a button, and get a result like this... YET. It is only a matter of time until we get there in the future, and I have plans to further improve the scalability of this process. Eventually it will take 2 days for me to do this, rather than 2 months!

Are you interested in making your own AI music videos? I’ve created a free post on patreon documenting all the resources I used to make this video so you can try it yourself. Here is the link:
https://www.patreon.com/posts/72825385

Want to see the exact settings and prompts I used to create this video? I've posted all of them here: https://www.patreon.com/posts/72829815

This is the longest music video I've posted on this channel, and it took me over 2 months of work to finish! If you'd like to support me and get your name featured at the end of each video in a mini game, here is a link to my patreon: https://www.patreon.com/doodlechaos

My social media:
Twitter: https://twitter.com/doodlechaos
Discord: https://discord.com/invite/7FCrWAzDY7
Tiktok: https://www.tiktok.com/@doodlechaos
Instagram Shorts: https://www.instagram.com/doodlechaos_shorts/
Email: contact@doodlechaos.com

Music:
Infected Mushroom & Bliss - Bliss on Mushrooms (feat. Miyavi) [Monstercat Release] : https://www.youtube.com/watch?v=ceYKKNXFpSE

End Screen Music:
lofi geek - Monster: https://www.youtube.com/watch?v=CfYYsKWAGLo

Art Credits:
Abandoned Warehouse Model by Aurélien Martel - https://sketchfab.com/3d-models/abandoned-warehouse-interior-scene-1d5285f2e0fd4211a27c8042496d5959

Apple 2 Computer On Desk by Hank-Ball - https://www.cgtrader.com/free-3d-models/electronics/computer/apple-2-computer-on-desk

For a few frames in 6:10 - 6:16 I used Greg Rutkowski's name in the prompt for Dalle2. For Greg's style influencing this section, I wish to properly credit him for his amazing art. https://twitter.com/GrzegorzRutko14

Input Videos Credit:
Techno Viking Video - https://www.youtube.com/watch?v=UjCdB5p2v0Y
Headbanger at Festival - https://www.youtube.com/watch?v=moorsjQznp4

Loading comments...