Stereo matching of binocular laparoscopic images with improved densely connected neural architecture search

• Published in: International journal for computer assisted radiology and surgery Vol. 19; no. 4; pp. 677 - 686
• Main Authors: Jin, Ziyi, Hu, Chunyong, Fu, Zuoming, Zhang, Chongan, Wang, Peng, Zhang, Hong, Ye, Xuesong
• Format: Journal Article
• Language: English
• Published: Cham Springer International Publishing 01.04.2024; Springer Nature B.V
• Subjects: Algorithms; Computer architecture; Computer Imaging; Computer Science; Datasets; Design; Feature extraction; Health Informatics; Imaging; Laparoscopy; Matching; Medicine; Medicine & Public Health; Navigation systems; Neural networks; Original Article; Pattern Recognition and Graphics; Radiology; Searching; Semantics; Surgery; Vision; Neural architecture search; Binocular laparoscopic images; Stereo matching; Surgical navigation
• ISSN: 1861-6429; 1861-6410; 1861-6429
• DOI: 10.1007/s11548-023-03035-5

Purpose Stereo matching is a crucial technology in the binocular laparoscopic-based surgical navigation systems. In recent years, neural networks have been widely applied to stereo matching and demonstrated outstanding performance. however, this method heavily relies on manual feature engineering meaning that professionals must be involved in the feature extraction and matching. This process is both time-consuming and demands specific expertise. Methods This paper introduces a novel stereo matching framework DCStereo that realizes a fully automatic neural architecture design for the stereo matching of binocular laparoscopic images. The proposed framework utilizes a densely connected search space which enables a more flexible and diverse architecture composition. Furthermore, the proposed algorithm leverages the channel and path sampling strategies to reduce memory consumption during searching. Results Empirically, our searched DCStereo on the SCARED training dataset achieves a mean absolute error of 3.589 mm on the test dataset, which outperforms hand-crafted stereo matching methods and other approaches. Furthermore, when directly testing on the SERV-CT dataset, our DCStereo demonstrates better generalization ability than other methods. Conclusion Our proposed approach leverages the neural architecture search technique and a densely connected search space for automatic neural architecture design in stereo matching of binocular laparoscopic images. Our method delivers advanced performance on the SCARED dataset and promising results on the SERV-CT dataset. These findings demonstrate the potential of our approach for improving clinical surgical navigation systems.