LSMD: Long-Short Memory-Based Detection Network for Carotid Artery Detection in B-Mode Ultrasound Video Streams

• Published in: IEEE transactions on ultrasonics, ferroelectrics, and frequency control Vol. 71; no. 11; pp. 1464 - 1477
• Main Authors: Shan, Chunjie, Zhang, Yidan, Liu, Chunrui, Jin, Zhibin, Cheng, Hanlin, Chen, Yidi, Yao, Jing, Luo, Shouhua
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.11.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accuracy; Algorithms; Anatomical structure; Anatomy; Annotations; Atherosclerosis; Carotid arteries; Carotid Arteries - diagnostic imaging; Carotid artery; Carotid Artery Diseases - diagnostic imaging; Computer memory; detection network; Edge computing; Frequency control; Humans; Image enhancement; Image Interpretation, Computer-Assisted - methods; Inference; long-short memory-based; Medical imaging; Object detection; Performance evaluation; Physicians; Plaque, Atherosclerotic - diagnostic imaging; Real time; Real-time systems; Solid state devices; Streaming media; Streams; Ultrasonic imaging; Ultrasonography - methods; ultrasound video streams; Video data; Video Recording - methods
• ISSN: 0885-3010; 1525-8955; 1525-8955
• DOI: 10.1109/TUFFC.2024.3494019

Carotid atherosclerotic plaques are a major complication associated with type II diabetes, and carotid ultrasound is commonly used for diagnosing carotid vascular disease. In primary hospitals, less experienced ultrasound physicians often struggle to consistently capture standard carotid images and identify plaques. To address this issue, we propose a novel approach, the long-short memory-based detection (LSMD) network, for carotid artery detection in ultrasound video streams, facilitating the identification and localization of critical anatomical structures and plaques. This approach models short- and long-distance spatiotemporal features through short-term temporal aggregation (STA) and long-term temporal aggregation (LTA) modules, effectively expanding the temporal receptive field with minimal delay and enhancing the detection efficiency of carotid anatomy and plaques. Specifically, we introduce memory buffers with a dynamic updating strategy to ensure extensive temporal receptive field coverage while minimizing memory and computation costs. The proposed model was trained on 80 carotid ultrasound videos and evaluated on 50, with all videos annotated by physicians for carotid anatomies and plaques. The trained LSMD was evaluated for performance on the validation and test sets using the single-frame image-based single shot multibox detector (SSD) algorithm as a baseline. The results show that the precision, recall, average precision (AP) at <inline-formula> <tex-math notation="LaTeX">\text {IoU}={0.50} </tex-math></inline-formula> (<inline-formula> <tex-math notation="LaTeX">\text {AP}_{{50}} </tex-math></inline-formula>), and mean AP (mAP) are 6.83%, 12.29%, 11.23%, and 13.21% higher than the baseline (<inline-formula> <tex-math notation="LaTeX">{p}\lt {0.001} </tex-math></inline-formula>), respectively, while the model's inference latency reaches 6.97 ms on a desktop-level GPU (NVIDIA RTX 3090Ti) and 29.69 ms on an edge computing device (Jetson Orin Nano). These findings demonstrate that LSMD can accurately localize carotid anatomy and plaques with real-time inference, indicating its potential for enhancing diagnostic accuracy in clinical practice.