Ballet E-learning using fuzzy set induced posture recognition by piece-wise linear approximation of connected components

• Published in: Applied soft computing Vol. 65; pp. 554 - 576
• Main Authors: Saha, Sriparna, Rakshit, Pratyusha, Konar, Amit
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.04.2018
• Subjects: Ballet; E-learning; Modified artificial bee colony; Piece-wise linear approximation; Type-1 fuzzy set; E-learning; Piece-wise linear approximation; Type-1 fuzzy set; Modified artificial bee colony; Ballet
• ISSN: 1568-4946; 1872-9681
• DOI: 10.1016/j.asoc.2018.01.043

•The present work has aimed at recognition of ballet posture by a learner at home, while he/she is executing the posture following the same of a trained dancer in the video.•The optimal polygonal approximation of boundary is here realized using a modified version of the traditional artificial bee colony (ABC) algorithm.•The relative performance of all the algorithms has been compared on the basis of seven performance metrics, including recall, specificity, precision, accuracy, average error rate, receiver operating characteristic curve and area under curve.•The quality performance of the proposed algorithm is substantiated by the reported simulation results, with an accuracy of 91.23%.•Statistical significance of the results has been ascertained by Wilcoxon rank-sum test and the McNemar’s test. The paper proposes a novel strategy of ballet e-learning for novices in remote areas. The present work is concerned with a training dataset of thirty four different ballet postures, obtained from images of trained dancers. A four-step procedure is primarily followed to extract features from the training images describing a specific posture p. First, the acquired images of K trained dancers of a specific posture p are pre-processed. The connected components (CCs) of the pre-processed images are then identified, followed by piece-wise linear approximation of their respective boundaries. After that, the internal angles of the polygonal boundary are used to characterize features of the given posture. This is repeated for all images of K trained dancers, all performing the given posture p. The merit of the paper lies in recasting the problem of selecting the CC boundary points for polygonal approximation as an optimization problem. The inter-subject uncertainty observed in the feature values extracted from the pre-processed images of a large number of experts/trained dancers, all executing the same posture p, here has been modeled by Gaussian fuzzy membership curve. The class of an unknown posture (obtained from the image of a novice) is determined by computing the support of each known posture class to the given unknown postural expression. The class with the maximum support (above a pre-defined threshold value) is declared as the conqueror. Experiments undertaken reveal that the accuracy of recognizing an unknown ballet posture of a novice, captured by a stereo camera, by the proposed stratagem is as high as 91.23%.