Human-Directed Optical Music Recognition

• Published in: Electronic Imaging Vol. 28; no. 17; pp. 1 - 9
• Main Authors: Chen, Liang, Raphael, Christopher
• Format: Journal Article
• Language: English
• Published: Society for Imaging Science and Technology 17.02.2016
• ISSN: 2470-1173; 2470-1173
• DOI: 10.2352/ISSN.2470-1173.2016.17.DRR-053

We propose a human-in-the-loop scheme for optical music recognition. Starting from the results of our recognition engine, we pose the problem as one of constrained optimization, in which the human can specify various pixel labels, while our recognition engine seeks an optimal explanation subject to the humansupplied constraints. In this way we enable an interactive approach with a uniform communication channel from human to machine where both iterate their roles until the desired end is achieved. Pixel constraints may be added to various stages, including staff finding, system identification, and measure recognition. Results on a test show significant speed up when compared to purely human-driven correction.