Multimodal Medical Image Fusion Using Two- Stage Decomposition Technique to Combine the Significant Features of Spatial Fuzzy Plane and Transformed Frequency Plane

• Published in: IEEE transactions on instrumentation and measurement Vol. 72; pp. 1 - 10
• Main Authors: Jana, Mayukhmala, Das, Arpita
• Format: Journal Article
• Language: English
• Published: New York IEEE 2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Amplitude spectrum; Amplitudes; Clustering algorithms; Computer vision; Decomposition; Discrete cosine transform; Discrete Fourier transforms; fine-structural component; Fourier transforms; fusion rules; gross-structural component; Image color analysis; Image edge detection; Image filters; Image fusion; Information filters; Medical imaging; multimodal fusion; Neural networks; Optimization; phase spectrum; Quantitative analysis; Signal to noise ratio; Singular value decomposition; Topology; Transforms; two-stage decomposition
• ISSN: 0018-9456; 1557-9662
• DOI: 10.1109/TIM.2023.3240222

Multimodal medical image fusion is becoming a powerful technique in various clinical applications such as disease diagnosis and treatment planning. In this work, a two-stage decomposition technique is proposed to capture the significant features from the spatial and spectral domains as well. The first stage decomposition method employs a multicluster fuzzy c-means (FCM) algorithm to produce gross- and fine-structural components. The fine-structural components containing the edge topology are again decomposed into amplitude and phase spectra in terms of the discrete cosine transformation-based discrete Fourier transform (DCT-DFT). Finally, all parts of decomposed images are integrated with three different fusion rules. A new window-based feature quality measuring (WFQM) filter is proposed for fusing the information of gross-structural components, while the singular value decomposition (SVD) method and gray-wolf optimization-based pulse-coupled neural network (GWO-PCNN) model are applied for fusing the amplitude and phase spectrum distributions of input images. As the WFQM filter and GWO-PCNN model are designed to fuse the significant information from the spatial fuzzy plane and transformed frequency plane respectively, relative contrast degradation and spectral distortion are less in the proposed fusion method. Experimental results are reported on Harvard University datasets and some qualitative as well as quantitative measures are presented for comparing the proposed method with other state-of-art-techniques. The quantitative evaluation used peak signal-to-noise ratio (PSNR), mutual information (MI), structural similarity index measurement (SSIM), visual information fidelity (VIF), and entropy (ENT) to study its superiority.