Intelligent Patient Assessment & Monitoring System: Developing an Emotion Recognition Algorithm for Vocal Cues

• Published in: Archives of physical medicine and rehabilitation Vol. 105; no. 4; pp. e54 - e55
• Main Authors: Lofitou, Kalia, Theocharides, Theocharis, Constantinidou, Fofi, Pettemeridou, Eva
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.04.2024
• Subjects: intelligent Patient Assessment & Monitoring System; iPAMS; Rehabilitation; Traumatic Brain Injury; intelligent Patient Assessment & Monitoring System; Traumatic Brain Injury; Rehabilitation; iPAMS
• ISSN: 0003-9993
• DOI: 10.1016/j.apmr.2024.02.151

This project will develop an intelligent Patient Assessment & Monitoring System (iPAMS) consisting of different sensor networks and smart software algorithms with the ultimate goal to monitor and assess patients with TBI in the rehabilitation setting. Cross-sectional study. The study took place at the Centre for Applied Neuroscience, University of Cyprus. The algorithm developed was tested on a set of data collected from 24 neurotypical participants (male = 8; female = 16), with an age range of 18-51 (M = 27.08; SD = 7.34). The data set of the Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS) was used to create the algorithm of the Online Speech Emotion Recognition using Python 3.7.6. The code of speech expressions included happy, sad, angry, fearful, disgust, surprise, and neutral. The gender differentiation was also inserted to detect the different emotions between men and women. The output is a real-time speech emotion recognition. Not applicable. A sophisticated online algorithm has been developed to detect and classify vocal signals into different emotions. The speech recognition algorithm developed and implemented was shown to effectively detect and classify all targeted emotions, in men and women. Most importantly, this speech recognition technique can be applied in real-time emotion detection. These findings suggest that real-time voice processing algorithms could contribute towards the understanding of the emotional state of patients, more efficiently, prior to the presence of any disruptive behavior. The idea behind this is that this software algorithm could specifically identify a potential behavioral alert through a personalized patient profile and notify the rehabilitation facility and the patient with TBI with real-time feedback. None disclosed.