Deep learning-based liver segmentation for fusion-guided intervention

• Published in: International journal for computer assisted radiology and surgery Vol. 15; no. 6; pp. 963 - 972
• Main Authors: Fang, Xi, Xu, Sheng, Wood, Bradford J., Yan, Pingkun
• Format: Journal Article
• Language: English
• Published: Cham Springer International Publishing 01.06.2020; Springer Nature B.V
• Subjects: Algorithms; Computed tomography; Computer Imaging; Computer Science; Computer vision; Deep learning; Diagnostic systems; Health Informatics; Image acquisition; Image contrast; Image processing; Image registration; Image segmentation; Imaging; Liver; Machine learning; Magnetic resonance imaging; Medical imaging; Medicine; Medicine & Public Health; Multiscale analysis; Original Article; Pattern Recognition and Graphics; Placement; Positron emission; Radiology; Surgery; Tomography; Tumors; Vision; Deep learning; Image segmentation; Image-guided interventions; Image fusion
• ISSN: 1861-6410; 1861-6429; 1861-6429
• DOI: 10.1007/s11548-020-02147-6

Purpose Tumors often have different imaging properties, and there is no single imaging modality that can visualize all tumors. In CT-guided needle placement procedures, image fusion (e.g. with MRI, PET, or contrast CT) is often used as image guidance when the tumor is not directly visible in CT. In order to achieve image fusion, interventional CT image needs to be registered to an imaging modality, in which the tumor is visible. However, multi-modality image registration is a very challenging problem. In this work, we develop a deep learning-based liver segmentation algorithm and use the segmented surfaces to assist image fusion with the applications in guided needle placement procedures for diagnosing and treating liver tumors. Methods The developed segmentation method integrates multi-scale input and multi-scale output features in one single network for context information abstraction. The automatic segmentation results are used to register an interventional CT with a diagnostic image. The registration helps visualize the target and guide the interventional operation. Results The segmentation results demonstrated that the developed segmentation method is highly accurate with Dice of 96.1% on 70 CT scans provided by LiTS challenge. The segmentation algorithm is then applied to a set of images acquired for liver tumor intervention for surface-based image fusion. The effectiveness of the proposed methods is demonstrated through a number of clinical cases. Conclusion Our study shows that deep learning-based image segmentation can obtain useful results to help image fusion for interventional guidance. Such a technique may lead to a number of other potential applications.