Improving emotion recognition systems by embedding cardiorespiratory coupling

• Published in: Physiological measurement Vol. 34; no. 4; pp. 449 - 464
• Main Authors: Valenza, Gaetano, Lanatá, Antonio, Scilingo, Enzo Pasquale
• Format: Journal Article
• Language: English
• Published: England IOP Publishing 01.04.2013
• Subjects: Arousal - physiology; cardiorespiratory synchronization; dominant Lyapunov exponent; electrodermal response; emotion recognition systems; Emotions - physiology; Heart - physiology; heart rate variability; Humans; Models, Biological; quadratic discriminant classifiers; Respiration; respiration activity; weakly coupled oscillators; Young Adult
• ISSN: 0967-3334; 1361-6579; 1361-6579
• DOI: 10.1088/0967-3334/34/4/449

This work aims at showing improved performances of an emotion recognition system embedding information gathered from cardiorespiratory (CR) coupling. Here, we propose a novel methodology able to robustly identify up to 25 regions of a two-dimensional space model, namely the well-known circumplex model of affect (CMA). The novelty of embedding CR coupling information in an autonomic nervous system-based feature space better reveals the sympathetic activations upon emotional stimuli. A CR synchrogram analysis was used to quantify such a coupling in terms of number of heartbeats per respiratory period. Physiological data were gathered from 35 healthy subjects emotionally elicited by means of affective pictures of the international affective picture system database. In this study, we finely detected five levels of arousal and five levels of valence as well as the neutral state, whose combinations were used for identifying 25 different affective states in the CMA plane. We show that the inclusion of the bivariate CR measures in a previously developed system based only on monovariate measures of heart rate variability, respiration dynamics and electrodermal response dramatically increases the recognition accuracy of a quadratic discriminant classifier, obtaining more than 90% of correct classification per class. Finally, we propose a comprehensive description of the CR coupling during sympathetic elicitation adapting an existing theoretical nonlinear model with external driving. The theoretical idea behind this model is that the CR system is comprised of weakly coupled self-sustained oscillators that, when exposed to an external perturbation (i.e. sympathetic activity), becomes synchronized and less sensible to input variations. Given the demonstrated role of the CR coupling, this model can constitute a general tool which is easily embedded in other model-based emotion recognition systems.