Remote Assessment of Cognitive Impairment Level Based on Serious Mobile Game Performance: An Initial Proof of Concept

• Published in: IEEE journal of biomedical and health informatics Vol. 23; no. 3; pp. 1269 - 1277
• Main Authors: Jung, Hee-Tae, Daneault, Jean-Francois, Lee, Hyunsuk, Kim, Kwangwook, Kim, Byeongil, Park, Sungji, Ryu, Taekyeong, Kim, Yangsoo, Lee, Sunghoon Ivan
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.05.2019; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Aged; Aged, 80 and over; Animals; Cognitive ability; Cognitive Dysfunction - diagnosis; cognitive impairment; Computer & video games; Educational software; Female; Games; Humans; Impairment; Informatics; Land mobile radio; Learning algorithms; Machine learning; Male; Mental Status and Dementia Tests; Middle Aged; mini mental state examination; mobile game; remote monitoring; Serious game; Shape; Short term memory; Spatial memory; Telemedicine - methods; Video Games; Visualization
• ISSN: 2168-2194; 2168-2208; 2168-2208
• DOI: 10.1109/JBHI.2019.2893897

Individuals with cognitive impairments are evaluated using clinically validated cognitive assessment tools, which need to be administered by trained therapists. This serves as a major barrier for frequent and longitudinal monitoring of patients' cognitive impairment level. We introduce Neuro-World, a set of six mobile games designed to challenge visuospatial short-term memory and selective attention, which allows one to self-administer the assessment of his/her cognitive impairment level. Game performance is analyzed to estimate a widely accepted clinical measure, the mini mental state examination (MMSE), which highlights the translational impact of the system in real-world settings. We collected game-specific performance data from 12 post-stroke patients at baseline and a three-month follow-up, which were used to train supervised machine learning models to estimate the corresponding MMSE scores. The results presented herein show that the proposed approach can estimate the MMSE scores with a normalized root mean square error of 5.75%. We also validate the system's responsiveness to longitudinal changes in cognitive impairment level and demonstrate the system's positive usability in cognitively impaired individuals and their willingness to adhere to the longitudinal use. This study demonstrates that Neuroworld has great potential to be used to evaluate the cognitive impairment level and monitor its long-term change. This study enables new clinical and research opportunities for accurate, longitudinal assessment of cognitive function via mobile games.