AI based algorithms for the detection of (ir)regularity in musical structure

• Published in: International journal of applied mathematics and computer science Vol. 30; no. 4; pp. 761 - 772
• Main Authors: Mihelač, Lorena, Povh, Janez
• Format: Journal Article
• Language: English
• Published: Zielona Góra Sciendo 01.12.2020; De Gruyter Brill Sp. z o.o., Paradigm Publishing Services
• Subjects: AI algorithms; Algorithms; Artificial intelligence; Artificial neural networks; Deviation; Music; musical structure; perception; Regularity; Statistical analysis; Support vector machines
• ISSN: 1641-876X; 2083-8492; 2083-8492
• DOI: 10.34768/amcs-2020-0056

Regularity in musical structure is experienced as a strongly structured texture with repeated and periodic patterns, with the musical ideas presented in an appreciable shape to the human mind. We recently showed that manipulation of musical content (i.e., deviation of musical structure) affects the perception of music. These deviations were detected by musical experts, and the musical pieces containing them were labelled as irregular. In this study, we replace the human expert involved in detection of (ir)regularity with artificial intelligence algorithms. We evaluated eight variables measuring entropy and information content, which can be analysed for each musical piece using the computational model called Information Dynamics of Music and different viewpoints. The algorithm was tested using 160 musical excerpts. A preliminary statistical analysis indicated that three of the eight variables were significant predictors of regularity (E cpitch, IC cpintfref, and E cpintfref). Additionally, we observed linear separation between regular and irregular excerpts; therefore, we employed support vector machine and artificial neural network (ANN) algorithms with a linear kernel and a linear activation function, respectively, to predict regularity. The final algorithms were capable of predicting regularity with an accuracy ranging from 89% for the ANN algorithm using only the most significant predictor to 100% for the ANN algorithm using all eight prediction variables.