Piggybacking Detection Based on Coupled Body-Feet Recognition at Entrance Control

• Published in: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications Vol. 11896; pp. 780 - 789
• Main Authors: Siegmund, Dirk, Tran, Vinh Phuc, von Wilmsdorff, Julian, Kirchbuchner, Florian, Kuijper, Arjan
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 2019; Springer International Publishing
• Series: Lecture Notes in Computer Science
• ISBN: 3030339033; 9783030339036
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-030-33904-3_74

A major risk of an automated high-security entrance control is that an authorized person takes an unauthorized person into the secured area. This practice is called “piggybacking”. Known systems try to prevent it by using physical barriers combined with sensory or camera based algorithms. In this paper we present a multi-sensor solution for verifying the number of persons that stand within a defined transit area. We use sensors that are installed in the floor to detect feet as well as camera shots taken from above. We propose an image-based approach that uses change detection to extract motion from a sequence of images and classify it by using a convolutional neural network. Our sensor-based approach shows how user interactions can be used to facilitate safe separation. Both methods are computationally efficient so they can be used in embedded systems. In the evaluation, we were able to achieve state-of-the-art results for both approaches individually. Merging both methods sustainably prevents piggybacking, at a BPCER of 7.1%, where bona fide presentations are incorrectly classified as presentation attacks.