Research
Current and completed research projects spanning automatic transcription, real-time accompaniment, music–video generation, and embodied performance.
Projects
Spring 2024 – present
Robot Cello
Using reinforcement learning to teach a robot arm to play cello. The project partners with the Purdue Envision Center for motion-capture training data.
Learn more
Fall 2024 – present
Automatic Music Transcription
Streamlining audio-to-MIDI transcription for musicians and educators, with applications in isolating sounds in noisy environments.
Learn more
Fall 2023 – present
Evaluator Sound
A mobile and web app that helps musicians practice more effectively by reviewing music performance audio for extra, missed, or wrong notes, using the novel LadderSym (ICLR 2026) and Polytune (AAAI 2025) transformer models.
Learn more
Spring 2025 – present
Evaluator Vision
A mobile app that provides feedback on cellist posture in real time using on-device computer vision through the YOLO and Google MediaPipe frameworks.
Learn more
Fall 2023 – Spring 2025
Companion
An app that plays along with a human player during a chamber music piece and actively responds to their playing habits and voice commands.
Learn more
Spring 2022 – Fall 2025
Mus2Vid
A real-time art project that uses diffusion models to generate video depictions in response to classical music, with recurrent and transformer networks estimating emotion and genre.
Learn more