Spatiotemporal registration and fusion of transthoracic echocardiography and volumetric coronary artery tree

• Published in: International journal for computer assisted radiology and surgery Vol. 16; no. 9; pp. 1493 - 1505
• Main Authors: Ghodsizad, Talayeh, Behnam, Hamid, Fatemizadeh, Emad, Faghihi Langroudi, Taraneh, Bayat, Fariba
• Format: Journal Article
• Language: English
• Published: Cham Springer International Publishing 01.09.2021; Springer Nature B.V
• Subjects: Accuracy; Algorithms; Angiography; Computed tomography; Computer Imaging; Computer Science; Computer vision; Echocardiography; Free form; Health Informatics; Image processing; Imaging; Machine learning; Manifolds (mathematics); Medical imaging; Medicine; Medicine & Public Health; Metric space; Optical tracking; Optimization; Original Article; Pattern Recognition and Graphics; Pattern search; Radiology; Registration; Surgery; Tracking systems; Vision; Manifold learning; Slice-to-volume registration; Heart chambers extraction; Multimodal cardiac image fusion
• ISSN: 1861-6410; 1861-6429; 1861-6429
• DOI: 10.1007/s11548-021-02421-1

Purpose Cardiac multimodal image fusion can offer an image with various types of information in a single image. Many coronary stenosis, which are anatomically clear, are not functionally significant. The treatment of such kind of stenosis can cause irreversible effects on the patient. Thus, choosing the best treatment planning depend on anatomical and functional information is very beneficial. Methods An algorithm for the fusion of coronary computed tomography angiography (CCTA) as an anatomical and transthoracic echocardiography (TTE) as a functional modality is presented. CCTA and TTE are temporally registered using manifold learning. A pattern search optimization algorithm, using normalized mutual information, is used to find the best match slice to TTE frame from CCTA volume. By employing a free-form deformation, the heart's non-rigid deformations are modeled. The spatiotemporal registered TTE frame is embedded to achieve the fusion result. Results The accuracy is evaluated on CCTA and TTE data obtained from 10 patients. In temporal registration, mean absolute error of 1.97 ± 1.23 is resulted from comparing the output frame numbers from the algorithm and from manual assignment by an expert. In spatial registration, the accuracy of the similarity between the best match slice from CCTA volume and TTE frame is resulted in 1.82 ± 0.024 mm, 6.74 ± 0.013 mm, and 0.901 ± 0.0548 due to mean absolute distance, Hausdorff distance, and Dice similarity coefficient, respectively. Conclusion Without the use of ECG and Optical tracking systems, a semiautomatic framework of spatiotemporal registration and fusion of CCTA volume and TTE frame is presented. The experimental results showed the effectiveness of our proposed method to create complementary information from TTE and CCTA, which may help in the early diagnosis and effective treatment of cardiovascular diseases (CVDs).