Fall 2023 – present
Evaluator
An app that helps musicians practice more effectively, using computer vision and YOLO localization to track posture, with spectrogram analysis and multi-modal transformers to identify mistakes.
Evaluator is an app that aims to help musicians practice more effectively. It utilizes computer vision and YOLO localization techniques to help musicians track, analyze, and improve their posture. It also uses spectrogram analysis and multi-modal transformers to help the musicians identify their mistakes in music and correct them.
Publications
Detecting Music Performance Errors with Transformers — AAAI 2025.
Source
github.com/Purdue-Artificial-Intelligence-in-Music/Evaluator-code ↗
Team
- William Jiang (Vision Lead)
- Ryan Jordan (Audio Lead)
- Edward "Eddie" Navarro (Interaction Lead)