基于多尺度特征与频率注意力的轻量化矿井图像超分辨率重建方法

Lightweight super-resolution reconstruction method for mine images based on multi-scale feature fusion and frequency attention

  • 摘要: 在煤矿井下光照非均匀分布、煤尘水雾干扰与电磁噪声耦合的复杂工况中,矿井图像普遍面临分辨率退化、纹理细节模糊等挑战。传统超分辨率算法因网络结构复杂度高、内存占用大等问题,难以满足边缘设备的实时部署需求。针对上述问题,提出了一种基于多尺度特征与频率注意力的轻量化矿井图像超分辨率重建方法。首先,该网络基于像素注意力与多尺度特征感知机制设计了多感受野注意力模块,通过感知不同尺度的空间上下文信息,增强图像纹理边缘的表征能力。其次,设计了基于Transformer的自适应加权多尺度特征融合机制,通过可学习的权重融合多尺度卷积提取的特征,并结合门控深度卷积前馈网络,提升图像全局结构的一致性。最后,在上采样阶段引入频率注意力机制,通过频域信息指导高频细节重建。实验结果表明,本文方法不仅在客观评价指标和主观视觉分析上优于现有主流算法,而且在模型性能和轻量化之间取得更好的平衡。在4倍缩放因子下,与轻量级模型IMFRN相比,提出的模型参数量仅为617K,降低了22%,在复杂纹理场景的Urban100数据集上客观指标PSNR和SSIM分别提高0.05dB和0.0041,在矿井测试集上PSNR和SSIM分别提高0.11dB和0.0031。结果证明了该方法可以有效提取图像多尺度的纹理特征,实现跨层级的特征关联,在轻量化约束下重建出高频细节更清晰的高分辨率图像,为矿井边缘设备部署提供高效解决方案。

     

    Abstract: In the complex working conditions of coal mines characterized by non-uniform illumination distribution, interference from coal dust and water mist, and coupled electromagnetic noise, mine images commonly suffer from challenges such as resolution degradation and blurred texture details. Traditional super-resolution algorithms, due to their high network complexity and large memory footprint, struggle to meet the real-time deployment requirements on edge devices. To address these issues, a lightweight coal mine image super-resolution reconstruction method based on multi-scale features and frequency attention is proposed. Firstly, the network introduces a multi-receptive-field attention module based on pixel attention and multi-scale feature perception. This module enhances the representation of image textures and edges by capturing spatial contextual information at different scales. Secondly, an adaptive weighting multi-scale feature fusion mechanism based on Transformer is designed, which integrates features extracted by multi-scale convolutions through learnable weights. Combined with a gated depth-wise convolutional feed-forward network, it further improves global structural consistency of the reconstructed image. Finally, a frequency attention mechanism is introduced during the upsampling stage to guide the reconstruction of high-frequency details using frequency domain information. Experimental results demonstrate that the proposed method not only outperforms existing mainstream algorithms in both quantitative evaluation metrics and subjective visual analysis but also achieves a better balance between model performance and lightweight design. At a scaling factor of 4,compared to the lightweight model IMFRN, the proposed model has a parameter count of only 617K, representing a 22% reduction, while improving the objective metrics PSNR and SSIM by 0.05 dB and 0.0041, respectively, on the complex-texture Urban100 dataset, and by 0.11 dB and 0.0031 on the coal mine test set. The results prove that this method can effectively extract multi-scale texture features of images, achieve cross-level feature correlation,and reconstruct high-resolution images with clearer high-frequency details under lightweight constraints, providing an efficient solution for deployment on mine edge devices.

     

/

返回文章
返回