Enhanced low-light image fusion through multi-stage processing with Bayesian analysis and quadratic contrast function

• Published in: Scientific reports Vol. 14; no. 1; pp. 16987 - 29
• Main Authors: Sharma, Apoorav Maulik, Vig, Renu, Dogra, Ayush, Goyal, Bhawna, Alkhayyat, Ahmed, Kukreja, Vinay, Saikia, Manob Jyoti
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 23.07.2024; Nature Publishing Group; Nature Portfolio
• Subjects: 639/166/987; 639/766/400; Algorithms; Bayesian analysis; Bayesian fuse; Decomposition; Engineering; Humanities and Social Sciences; Image fusion; Image processing; Information processing; Lipschitz constraints; multidisciplinary; Noise reduction; Preservation; Quadratic contrast; Science; Science (multidisciplinary); Surveillance; Visible; Bayesian fuse; Visible; IR; Surface from shade; Image fusion; Quadratic contrast; Lipschitz constraints
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-024-67502-y

This manuscript introduces an innovative multi-stage image fusion framework that adeptly integrates infrared (IR) and visible (VIS) spectrum images to surmount the difficulties posed by low-light settings. The approach commences with an initial preprocessing stage, utilizing an Efficient Guided Image Filter for the infrared (IR) images to amplify edge boundaries and a function for the visible (VIS) images to boost local contrast and brightness. Utilizing a two-scale decomposition technique that incorporates Lipschitz constraints-based smoothing, the images are effectively divided into distinct base and detail layers, thereby guaranteeing the preservation of essential structural information. The process of fusion is carried out in two distinct stages: firstly, a method grounded in Bayesian theory is employed to effectively combine the base layers, so effectively addressing any inherent uncertainty. Secondly, a Surface from Shade (SfS) method is utilized to ensure the preservation of the scene's geometry by enforcing integrability on the detail layers. Ultimately a Choose Max principle is employed to determine the most prominent textural characteristics, resulting in the amalgamation of the base and detail layers to generate an image that exhibits a substantial enhancement in both clarity and detail. The efficacy of our strategy is substantiated by rigorous testing, showcasing notable progressions in edge preservation, detail enhancement, and noise reduction. Consequently, our method presents significant advantages for real-world applications in image analysis.