Comparing Classification Algorithms to Recognize Selected Gestures Based on Microsoft Azure Kinect Joint Data

• Published in: Information (Basel) Vol. 16; no. 5; p. 421
• Main Authors: Funken, Marc, Hanne, Thomas
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.05.2025
• Subjects: Accuracy; Algorithms; Artificial intelligence; Artificial neural networks; Atrophy; Cameras; Classification; Computer & video games; Computer vision; decision tree; Decision trees; Decision-making; gamification; Gesture recognition; joint tracking; Machine learning; Monitoring; neural network; Neural networks; Pharmaceutical industry; Physical exercise; Posture; Range of motion; recurrent neural network; Recurrent neural networks; Rehabilitation; Research methodology; Sensors; Software; Supervised learning; Telemedicine; New Jersey
• ISSN: 2078-2489; 2078-2489
• DOI: 10.3390/info16050421

This study aims to explore the potential of exergaming (which can be used along with prescriptive medication for children with spinal muscular atrophy) and examine its effects on monitoring and diagnosis. The present study focuses on comparing models trained on joint data for gesture detection, which has not been extensively explored in previous studies. The study investigates three approaches to detect gestures based on 3D Microsoft Azure Kinect joint data. We discuss simple decision rules based on angles and distances to label gestures. In addition, we explore supervised learning methods to increase the accuracy of gesture recognition in gamification. The compared models performed well on the recorded sample data, with the recurrent neural networks outperforming feedforward neural networks and decision trees on the captured motions. The findings suggest that gesture recognition based on joint data can be a valuable tool for monitoring and diagnosing children with spinal muscular atrophy. This study contributes to the growing body of research on the potential of virtual solutions in rehabilitation. The results also highlight the importance of using joint data for gesture recognition and provide insights into the most effective models for this task. The findings of this study can inform the development of more accurate and effective monitoring and diagnostic tools for children with spinal muscular atrophy.