Color Restoration Method for Endoscope Image Using Multiscale Discriminator Based Model Compression Strategy

• Published in: 2022 7th International Conference on Computational Intelligence and Applications (ICCIA) pp. 161 - 166
• Main Authors: Hao, Pengcheng, Ai, Danni, Zang, Liugeng, Fan, Jingfan, Yang, Jian
• Format: Conference Proceeding
• Language: English
• Published: IEEE 24.06.2022
• Subjects: color restoration; Deep learning; endoscope image; Endoscopes; generative adversarial network; Image coding; Image color analysis; Image quality; network compression; Surgery; Training
• DOI: 10.1109/ICCIA55271.2022.9828438

Color restoration of endoscopic images is an urgent clinical need during photodynamic surgery. In recent years, deep learning methods achieved notable results in the fields of image processing. The model compression algorithm and hardware performance enhancement improved the model inference speed. It is possible to apply deep learning methods to the task of endoscopic image color restoration during surgery. However, experiments show that model compression can lead to image deterioration. To solve this issue, we propose a fast color restoration method for endoscopic images, which use multiscale discriminator based on model compression. Initially, we train a CycleGAN teacher network with multiscale discriminator. Then, we obtain the student model through knowledge distillation and neural architecture search. We use the trained teacher discriminator to guide the student model and add feature matching loss to stabilize the training process. Experiments show that our method ameliorates the performance of compressed models.