Fall 2023 – present
Evaluator Sound
A mobile and web app that helps musicians practice more effectively by reviewing music performance audio for extra, missed, or wrong notes, using the novel LadderSym (ICLR 2026) and Polytune (AAAI 2025) transformer models.

Evaluator Sound is a mobile and web app that helps musicians practice more effectively by listening to their playing. It uses spectrogram analysis and multi-modal transformers to tell correct from incorrect playing, detecting extra, missed, and wrong notes, and returns an annotated score to help the player review detected errors.
The error-detection models compare performance audio with a reference: Polytune (AAAI 2025) uses reference audio, while LadderSym (ICLR 2026) also uses a symbolic score. They produce note-level annotations identifying correct, missed, and extra notes.
Publications
LadderSym: A Multimodal Interleaved Transformer for Music Practice Error Detection, ICLR 2026.
Detecting Music Performance Errors with Transformers, AAAI 2025.
Team
- Ropan Datta (Lead)
- Benjamin "Ben" Shiue-Hal Chou (Graduate Mentor)