Fall Detection Based on Fusion of Passive and Active Acoustic Sensing

• Published in: IEEE internet of things journal Vol. 11; no. 7; pp. 11566 - 11578
• Main Authors: Chen, Diannan, Wong, Aslan B., Wu, Kaishun
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.04.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Acoustic sensing; Acoustics; Adults; Anomalies; Background noise; Fall detection; Feature extraction; Harnesses; Mel frequency cepstral coefficient; multimodal classification; Observers; Older people; passive and active sensing; Redundancy; Sensors; Spectrogram
• ISSN: 2327-4662; 2327-4662
• DOI: 10.1109/JIOT.2023.3331698

Numerous studies have extensively examined the living conditions of older adults who live alone, highlighting falls as the most significant threat to their well-being. Recognizing the critical importance of fall detection for older adults, researchers have conducted numerous investigations over the past decade to develop fall detection systems utilizing various detection methods. In this article, we further explore the potential of acoustic signals in detecting fall events and propose a novel system called FA-Fall, which fully harnesses acoustic signals for fall detection. Our approach revolves around fusing passive and active acoustic sensing through a pair of audio transceivers. We design a multimodal classification framework that integrates an attention mechanism and an anomaly detection mechanism to capitalize on the complementary and redundancy of passive and active sensing. We implemented the FA-Fall system and carried out extensive experiments to evaluate its performance. The results demonstrate that FA-Fall achieves an impressive overall accuracy of 98.97% under typical environmental conditions. Furthermore, it can still detect fall events with over 90% accuracy in challenging environments characterized by considerable background noise or nonline-of-sight conditions.