Respiration Based Non-Invasive Approach for Emotion Recognition Using Impulse Radio Ultra Wide Band Radar and Machine Learning

• Published in: Sensors (Basel, Switzerland) Vol. 21; no. 24; p. 8336
• Main Authors: Siddiqui, Hafeez Ur Rehman, Shahzad, Hina Fatima, Saleem, Adil Ali, Khan Khakwani, Abdul Baqi, Rustam, Furqan, Lee, Ernesto, Ashraf, Imran, Dudley, Sandra
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 13.12.2021; MDPI
• Subjects: Accuracy; Artificial intelligence; Autism; Brain research; Electrocardiography; Electroencephalography; Electromyography; Emotions; Female; Happiness; Heart rate; Humans; Machine Learning; Male; Nervous system; non-invasive emotion recognition; physiological signals; Physiology; Radar; Respiration; respiration rate; Sensors; Signal Processing, Computer-Assisted; Skin; ultra-wide band; ultra-wide band; non-invasive emotion recognition; physiological signals; machine learning; respiration rate
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s21248336

Emotion recognition gained increasingly prominent attraction from a multitude of fields recently due to their wide use in human-computer interaction interface, therapy, and advanced robotics, etc. Human speech, gestures, facial expressions, and physiological signals can be used to recognize different emotions. Despite the discriminating properties to recognize emotions, the first three methods have been regarded as ineffective as the probability of human’s voluntary and involuntary concealing the real emotions can not be ignored. Physiological signals, on the other hand, are capable of providing more objective, and reliable emotion recognition. Based on physiological signals, several methods have been introduced for emotion recognition, yet, predominantly such approaches are invasive involving the placement of on-body sensors. The efficacy and accuracy of these approaches are hindered by the sensor malfunctioning and erroneous data due to human limbs movement. This study presents a non-invasive approach where machine learning complements the impulse radio ultra-wideband (IR-UWB) signals for emotion recognition. First, the feasibility of using IR-UWB for emotion recognition is analyzed followed by determining the state of emotions into happiness, disgust, and fear. These emotions are triggered using carefully selected video clips to human subjects involving both males and females. The convincing evidence that different breathing patterns are linked with different emotions has been leveraged to discriminate between different emotions. Chest movement of thirty-five subjects is obtained using IR-UWB radar while watching the video clips in solitude. Extensive signal processing is applied to the obtained chest movement signals to estimate respiration rate per minute (RPM). The RPM estimated by the algorithm is validated by repeated measurements by a commercially available Pulse Oximeter. A dataset is maintained comprising gender, RPM, age, and associated emotions which are further used with several machine learning algorithms for automatic recognition of human emotions. Experiments reveal that IR-UWB possesses the potential to differentiate between different human emotions with a decent accuracy of 76% without placing any on-body sensors. Separate analysis for male and female participants reveals that males experience high arousal for happiness while females experience intense fear emotions. For disgust emotion, no large difference is found for male and female participants. To the best of the authors’ knowledge, this study presents the first non-invasive approach using the IR-UWB radar for emotion recognition.