Black MIDI, but every note spawns a physics object... (4k, 60fps, ray traced)
I created a program in Unity that can read Black MIDI files and generate a Synthesia like visualization. However, each time a piano key is pressed, a corresponding tetromino physics object is spawned (since it plays the Tetris Theme A). The high note density areas created some interesting effects.
I had a simpler version of this almost done, but for some reason I always feel the need to do a bunch of extra modifications that people probably won't even notice (60fps + 4k, I still don't have a 4k monitor, so I don't even know what it truly looks like, lol). After figuring out how to use Unity's HDRP, I couldn't resist setting up path tracing. Unfortunately, the Unity Recorder package isn't capable of waiting for the ray tracing paths to converge before moving to the next frame yet. To circumvent this, my code paused the simulation for about 200 frames for path convergence stalling, took a 4k screenshot, then repeated the process for about 72 hours straight. I was very sad when a bug in my code glitched out the physics at the very end of the simulation. Surprisingly, after fixing it and skipping a bunch of frames to set up a pick up shot where it failed, the physics behaved deterministically so the transition was unnoticeable.
Massive thanks to Kanade Tachibana for allowing me to use this MIDI file!
Link to original video: https://www.youtube.com/watch?v=XNN3dpCeF74
Link to Kanade Tachibana's channel: https://www.youtube.com/channel/UCAQJJ75WjNdvCIMXxzE3VCg
Music: Tetris Theme A
Cash Register Sound Effect:
https://freesound.org/people/kiddpark/sounds/201159/
It was super fun making the patron thank you outro screen. The blocks are ordered and sized in terms of lifetime contribution, as well as color coded by tier. I'm not making any money off this video. If you would like to support me and appear on screen in the next patron shoutout, here is the link to my Patreon page: https://www.patreon.com/doodlechaos
https://www.twitch.tv/doodlechaos
https://twitter.com/doodlechaos
contact@doodlechaos.com
-
5:20
Music Visualizations
2 years agoImpossible Piano Physics Simulation - In the Hall of the Mountain King | Black MIDI
9 -
2:59
Music Visualizations
4 years agoThe Piano Printer V2 - Marble Physics Simulation (Beethoven | Für Elise)
5 -
25:51
ChrisP Tutorials
10 months agoSound Reactive Geometry Nodes | Blender Tutorial How-To | Audio Music Simulation Frequency Spectrum
22 -
9:44
FrequencyisMydesign
2 years agoFREQUENCYIS MYDESIGN - The Color of Sound
33 -
0:07
IpseOScribitOLogica
1 year agoMisc Game Audio Loop
1 -
10:53
Robbie Strike
2 years ago $0.01 earnedEdit Midi Files - LMMS Linux MultiMedia Studio
87 -
11:51
Gourlie Records
1 year agoCreating an orchestra with a Casio SK-1 // KZO-LINA and KEYS Decent Sampler and Ableton Instrument
20 -
3:51
ObsidianWaves
2 months ago(Sin Copyright) Killabytez - Mechanical Resonance
6 -
8:46
Art Technology Exploration
1 year agoUnexpected Uses for KDEnlive Motion Tracking
9 -
0:22
IpseOScribitOLogica
1 year agoAlien BKGD Audio Loop