I Synchronized my Minecraft World to Music (MODDED for new effects!)

It took me 2 months to make this monstrosity. For this video, I learned how to mod Minecraft! I've been able to make similar videos before using other people's mods, but now I overhauled the whole system to have more control of the effects, and hopefully be able to make videos much faster. It was an emotional rollercoaster but I'm proud that I didn't give up. Here are the design requirements I laid out for myself:

1. Zero lag recording with highest render distance
2. Ability to control camera and block placement via keyframes in Blender (huge speed improvement)
3. Zero lag command injection via keyframes in Blender (fireworks, spawning falling blocks, control gametime, etc)
4. Manually tick specific game functions to control time (entities, particles, textures, etc)

As a noob coming into Minecraft modding with zero experience, I underestimated how big of an undertaking it would be for me to figure this out. The best analogy I can use is trying to reach the peak of the tallest mountain in a mountain range, but there is a thick fog that doesn't let you see which mountain is tallest. I would commit to one solution, only to realize I reached a local maximum, and have to backtrack and try a new method. The main source of my confusion was not understanding how the client and server communicated (Async thread communication is a nightmare lol). After redoing the mod from scratch 3 times, I finally found a system that worked.

I started this project with blind faith that I would figure out how to do it, without ever knowing for sure what I wanted to do was even possible. It was a bit of a risk, but this time my stubbornness to not give up paid off. With the generous help of others on Discord (Shoutout to DarkMatter for the math behind the torus tunnels!) I now have the Minecraft music visualizer I've been dreaming of!

Why am I doing this?
I strongly believe that all music deserves custom synchronized visuals. Music is still being uploaded to youtube with still image backgrounds in 2022? I think we can do something more engaging/interesting! My mission is to create "generators" that can produce music videos faster. This Minecraft generator is my first attempt at doing so. I plan to continue work on this generator, as well as other formats (AI, Unity, etc). It is still a bit buggy, but I hope to eventually get this mod to a state where it is user friendly and able to be released to the public.

Music: (Show my boi some love! NOW ON SPOTIFY)
https://open.spotify.com/artist/736G6EN6ceo8tNaxgN2BSK
https://distrokid.com/hyperfollow/corticus/once-in-a-while-feat-alina-renae
https://linktr.ee/corticus

If you want to support me so I can continue on this music video mission, here is a link to my Patreon: https://www.patreon.com/doodlechaos

Come hang on discord: https://discord.com/invite/7FCrWAzDY7
Twitter: https://twitter.com/doodlechaos
Official tiktok: https://www.tiktok.com/@doodlechaos
Email: [email protected]

Shader:
BSL_V8.2