Novel AI driven approach to classify infant motor functions

• Published in: Scientific reports Vol. 11; no. 1; pp. 9888 - 13
• Main Authors: Reich, Simon, Zhang, Dajie, Kulvicius, Tomas, Bölte, Sven, Nielsen-Saines, Karin, Pokorny, Florian B., Peharz, Robert, Poustka, Luise, Wörgötter, Florentin, Einspieler, Christa, Marschik, Peter B.
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 10.05.2021; Nature Publishing Group; Nature Portfolio
• Subjects: 692/308/575; 692/53/2423; 692/617/375; 692/699/375/346; Accuracy; Age; Babies; Brain research; Cerebral palsy; Cerebral Palsy - diagnosis; Cerebral Palsy - physiopathology; Child & adolescent psychiatry; Child Development - physiology; Datasets as Topic; Female; Humanities and Social Sciences; Humans; Image Interpretation, Computer-Assisted - methods; Infant; Infant, Newborn; Infants; Learning algorithms; Longitudinal Studies; Machine Learning; Male; Mass Screening - methods; Movement - physiology; multidisciplinary; Neural networks; Pilot Projects; Prospective Studies; Science; Science (multidisciplinary); Sensors
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-021-89347-5

The past decade has evinced a boom of computer-based approaches to aid movement assessment in early infancy. Increasing interests have been dedicated to develop AI driven approaches to complement the classic Prechtl general movements assessment (GMA). This study proposes a novel machine learning algorithm to detect an age-specific movement pattern, the fidgety movements (FMs), in a prospectively collected sample of typically developing infants. Participants were recorded using a passive, single camera RGB video stream. The dataset of 2800 five-second snippets was annotated by two well-trained and experienced GMA assessors, with excellent inter- and intra-rater reliabilities. Using OpenPose, the infant full pose was recovered from the video stream in the form of a 25-points skeleton. This skeleton was used as input vector for a shallow multilayer neural network (SMNN). An ablation study was performed to justify the network’s architecture and hyperparameters. We show for the first time that the SMNN is sufficient to discriminate fidgety from non-fidgety movements in a sample of age-specific typical movements with a classification accuracy of 88%. The computer-based solutions will complement original GMA to consistently perform accurate and efficient screening and diagnosis that may become universally accessible in daily clinical practice in the future.