Underwater Target Detection Utilizing Polarization Image Fusion Algorithm Based on Unsupervised Learning and Attention Mechanism

• Published in: Sensors (Basel, Switzerland) Vol. 23; no. 12; p. 5594
• Main Authors: Cheng, Haoyuan, Zhang, Deqing, Zhu, Jinchi, Yu, Hao, Chu, Jinkui
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 15.06.2023; MDPI
• Subjects: Algorithms; attention mechanism; Benchmarking; Deep learning; Entropy; image fusion; Image processing; Light; Machine learning; Methods; polarization; Sensors; underwater target detection; unsupervised learning; Unsupervised Machine Learning; Water; Wavelet transforms; polarization; underwater target detection; attention mechanism; image fusion; unsupervised learning
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s23125594

Since light propagation in water bodies is subject to absorption and scattering effects, underwater images using only conventional intensity cameras will suffer from low brightness, blurred images, and loss of details. In this paper, a deep fusion network is applied to underwater polarization images; that is, the underwater polarization images are fused with intensity images using the deep learning method. To construct a training dataset, we establish an experimental setup to obtain underwater polarization images and perform appropriate transformations to expand the dataset. Next, an end-to-end learning framework based on unsupervised learning and guided by an attention mechanism is constructed for fusing polarization and light intensity images. The loss function and weight parameters are elaborated. The produced dataset is used to train the network under different loss weight parameters, and the fused images are evaluated based on different image evaluation metrics. The results show that the fused underwater images are more detailed. Compared with light intensity images, the information entropy and standard deviation of the proposed method increase by 24.48% and 139%. The image processing results are better than other fusion-based methods. In addition, the improved U-net network structure is used to extract features for image segmentation. The results show that the target segmentation based on the proposed method is feasible under turbid water. The proposed method does not require manual adjustment of weight parameters, has faster operation speed, and has strong robustness and self-adaptability, which is important for research in vision fields, such as ocean detection and underwater target recognition.