Spoofing speech detection using temporal convolutional neural network

• Published in: 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA) pp. 1 - 6
• Main Authors: Xiaohai Tian, Xiong Xiao, Eng Siong Chng, Haizhou Li
• Format: Conference Proceeding
• Language: English
• Published: Asia Pacific Signal and Information Processing Association 01.12.2016
• Subjects: Convolution; Feature extraction; Natural languages; Neural networks; Speech; Trajectory; Vocoders
• DOI: 10.1109/APSIPA.2016.7820738

Spoofing speech detection aims to differentiate spoofing speech from natural speech. Frame-based features are usually used in most of previous works. Although multiple frames or dynamic features are used to form a super-vector to represent the temporal information, the time span covered by these features are not sufficient. Most of the systems failed to detect the non-vocoder or unit selection based spoofing attacks. In this work, we propose to use a temporal convolutional neural network (CNN) based classifier for spoofing speech detection. The temporal CNN first convolves the feature trajectories with a set of filters, then extract the maximum responses of these filters within a time window using a max-pooling layer. Due to the use of max-pooling, we can extract useful information from a long temporal span without concatenating a large number of neighbouring frames, as in feedforward deep neural network (DNN). Five types of feature are employed to access the performance of proposed classifier. Experimental results on ASVspoof 2015 corpus show that the temporal CNN based classifier is effective for synthetic speech detection. Specifically, the proposed method brings a significant performance boost for the unit selection based spoofing speech detection.