TY - JOUR
T1 - Residual texture-aware infrared and visible image fusion with feature selection attention and adaptive loss
AU - Pan, Zhigeng
AU - Lin, Haitao
AU - Wu, Quan
AU - Xu, Guili
AU - Yu, Qida
N1 - Publisher Copyright:
© 2024 Elsevier B.V.
PY - 2024/8
Y1 - 2024/8
N2 - Infrared and visible image fusion plays a critical role in combining complementary information gathered from both types of images, thus enhancing the visual quality and the perception in the resulting fused image. Thus, this paper introduces RTAAFusion which is, an innovative image fusion framework that incorporates unique components. This proposed technique employs a Residual Texture-Aware Attention Block Module (RTAABM), meticulously engineered to effectively capture image disparities and texture information. Furthermore, it includes a feature selection attention mechanism that accurately identifies the importance and the weights of the different image features, thereby facilitating a precise and efficient fusion process. The framework also features an Adaptive Decision Block Loss (ADBL), which allows the fusion model to be adjusted to the distinctive characteristics and requirements of various image regions, thus leading to more accurate and targeted fusion results. Comprehensive experiments and comparisons with leading-edge approaches reflected the superior performance of RTAAFusion in terms of visual perception, information conservation, and spatial details across challenging scenarios and a broad range of image features. Therefore, RTAAFusion delivers a fast execution speed and is versatile across different scenarios and image features. This proposed framework shows immense potential for diverse applications within the field of infrared and visible image fusion.
AB - Infrared and visible image fusion plays a critical role in combining complementary information gathered from both types of images, thus enhancing the visual quality and the perception in the resulting fused image. Thus, this paper introduces RTAAFusion which is, an innovative image fusion framework that incorporates unique components. This proposed technique employs a Residual Texture-Aware Attention Block Module (RTAABM), meticulously engineered to effectively capture image disparities and texture information. Furthermore, it includes a feature selection attention mechanism that accurately identifies the importance and the weights of the different image features, thereby facilitating a precise and efficient fusion process. The framework also features an Adaptive Decision Block Loss (ADBL), which allows the fusion model to be adjusted to the distinctive characteristics and requirements of various image regions, thus leading to more accurate and targeted fusion results. Comprehensive experiments and comparisons with leading-edge approaches reflected the superior performance of RTAAFusion in terms of visual perception, information conservation, and spatial details across challenging scenarios and a broad range of image features. Therefore, RTAAFusion delivers a fast execution speed and is versatile across different scenarios and image features. This proposed framework shows immense potential for diverse applications within the field of infrared and visible image fusion.
KW - Adaptive decision block
KW - Infrared and visible image fusion
KW - Perception
KW - Residual texture-aware attention block module
UR - http://www.scopus.com/inward/record.url?scp=85197366953&partnerID=8YFLogxK
U2 - 10.1016/j.infrared.2024.105410
DO - 10.1016/j.infrared.2024.105410
M3 - Article
AN - SCOPUS:85197366953
SN - 1350-4495
VL - 140
JO - Infrared Physics and Technology
JF - Infrared Physics and Technology
M1 - 105410
ER -