IPCT-Net: Parallel information bottleneck modality fusion network for obstructive sleep apnea diagnosis

• Published in: Neural networks Vol. 181; p. 106836
• Main Authors: Hu, Shuaicong, Wang, Yanan, Liu, Jian, Cui, Zhaoqiang, Yang, Cuiwei, Yao, Zhifeng, Ge, Junbo
• Format: Journal Article
• Language: English
• Published: United States Elsevier Ltd 01.01.2025
• Subjects: Algorithms; Artificial Intelligence; CNN-Transformer network; Deep Learning; Diagnosis, Computer-Assisted - methods; Humans; Information bottleneck; Male; Modality fusion; Neural Networks, Computer; Obstructive sleep apnea (OSA); Polysomnography - methods; Sleep Apnea, Obstructive - diagnosis; CNN-Transformer network; Information bottleneck; Modality fusion; Obstructive sleep apnea (OSA)
• ISSN: 0893-6080; 1879-2782; 1879-2782
• DOI: 10.1016/j.neunet.2024.106836

Obstructive sleep apnea (OSA) is a common sleep breathing disorder and timely diagnosis helps to avoid the serious medical expenses caused by related complications. Existing deep learning (DL)-based methods primarily focus on single-modal models, which cannot fully mine task-related representations. This paper develops a modality fusion representation enhancement (MFRE) framework adaptable to flexible modality fusion types with the objective of improving OSA diagnostic performance, and providing quantitative evidence for clinical diagnostic modality selection. The proposed parallel information bottleneck modality fusion network (IPCT-Net) can extract local-global multi-view representations and eliminate redundant information in modality fusion representations through branch sharing mechanisms. We utilize large-scale real-world home sleep apnea test (HSAT) multimodal data to comprehensively evaluate relevant modality fusion types. Extensive experiments demonstrate that the proposed method significantly outperforms existing methods in terms of participant numbers and OSA diagnostic performance. The proposed MFRE framework delves into modality fusion in OSA diagnosis and contributes to enhancing the screening performance of artificial intelligence (AI)-assisted diagnosis for OSA.