Speech emotion recognition using convolutional and Recurrent Neural Networks

• Published in: 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA) pp. 1 - 4
• Main Authors: Wootaek Lim, Daeyoung Jang, Taejin Lee
• Format: Conference Proceeding
• Language: English
• Published: Asia Pacific Signal and Information Processing Association 01.12.2016
• Subjects: Convolution; Emotion recognition; Recurrent neural networks; Speech; Speech recognition
• DOI: 10.1109/APSIPA.2016.7820699

With rapid developments in the design of deep architecture models and learning algorithms, methods referred to as deep learning have come to be widely used in a variety of research areas such as pattern recognition, classification, and signal processing. Deep learning methods are being applied in various recognition tasks such as image, speech, and music recognition. Convolutional Neural Networks (CNNs) especially show remarkable recognition performance for computer vision tasks. In addition, Recurrent Neural Networks (RNNs) show considerable success in many sequential data processing tasks. In this study, we investigate the result of the Speech Emotion Recognition (SER) algorithm based on CNNs and RNNs trained using an emotional speech database. The main goal of our work is to propose a SER method based on concatenated CNNs and RNNs without using any traditional hand-crafted features. By applying the proposed methods to an emotional speech database, the classification result was verified to have better accuracy than that achieved using conventional classification methods.