Multi-Modal Imaging Genetics Data Fusion via a Hypergraph-Based Manifold Regularization: Application to Schizophrenia Study

• Published in: IEEE transactions on medical imaging Vol. 41; no. 9; pp. 2263 - 2272
• Main Authors: Zhang, Yipu, Zhang, Haowei, Xiao, Li, Bai, Yuntong, Calhoun, Vince D., Wang, Yu-Ping
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.09.2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Brain; Brain - diagnostic imaging; Data integration; Data models; Environmental factors; Feature extraction; Genetics; Graph theory; Humans; Hypergraph; Imaging; information fusion Imaging genetics; Magnetic Resonance Imaging - methods; Manifolds; Medical imaging; Mental disorders; Modal data; multi-modal data; Multimodal Imaging - methods; Multitasking; Neuroimaging; Regularization; Risk factors; Schizophrenia; Schizophrenia - diagnostic imaging; Schizophrenia - genetics; schizophrenia classification
• ISSN: 0278-0062; 1558-254X; 1558-254X
• DOI: 10.1109/TMI.2022.3161828

Recent studies show that multi-modal data fusion techniques combine information from diverse sources for comprehensive diagnosis and prognosis of complex brain disorder, often resulting in improved accuracy compared to single-modality approaches. However, many existing data fusion methods extract features from homogeneous networs, ignoring heterogeneous structural information among multiple modalities. To this end, we propose a Hypergraph-based Multi-modal data Fusion algorithm, namely HMF. Specifically, we first generate a hypergraph similarity matrix to represent the high-order relationships among subjects, and then enforce the regularization term based upon both the inter- and intra-modality relationships of the subjects. Finally, we apply HMF to integrate imaging and genetics datasets. Validation of the proposed method is performed on both synthetic data and real samples from schizophrenia study. Results show that our algorithm outperforms several competing methods, and reveals significant interactions among risk genes, environmental factors and abnormal brain regions.