I worked with Professor Mitja Hmeljak and fellow student Lucas Gottdenker on a music visualization research project utilizing Isochords, a unique way to visualize chord progressions within music.
Isochords create geometric shapes and lines representing different chord structures, and help illustrate the connections between different chords and the progressions between them.
Lucas focused on the visual aspects while I focused on audio processing. We decided the foundational work would best be done with MIDI, as doing full chordal analysis on raw audio is quite difficult.
The project was prety challenging for me as I had to learn as much C# scripting as I could in a short time, but I learned enough to begin implementation in Unity.
Due to the short amount of time we had to work on the project, and Lucas and I's busy schedules, we were unable to successfully integrate the full audio analysis into the visual analysis, however a facsimile was possible through visualizing the actual MIDI input.
The GitHub repository for the audio-only Unity project can be found here.