Abstract
Generative Adversarial Networks (GANs) have achieved realistic super-resolution (SR) of images however, they lack semantic consistency and per-pixel confidence, limiting their credibility in critical remote sensing applications such as disaster response, urban planning and agriculture. This paper introduces Semantic and Uncertainty-Aware ESRGAN (SU-ESRGAN), the first SR framework designed for satellite imagery to integrate the ESRGAN, segmentation loss via DeepLabv3 for class detail preservation and Monte Carlo dropout to produce pixel-wise uncertainty maps. The SU-ESRGAN produces results (PSNR, SSIM, LPIPS) comparable to the Baseline ESRGAN on aerial imagery. This novel model is valuable in satellite systems or UAVs that use wide field-of-view (FoV) cameras, trading off spatial resolution for coverage. The modular design allows integration in UAV data pipelines for on-board or post-processing SR to enhance imagery resulting due to motion blur, compression and sensor limitations. Further, the model is fine-tuned to evaluate its performance on cross domain applications. The tests are conducted on two drone based datasets which differ in altitude and imaging perspective. Performance evaluation of the fine-tuned models show a stronger adaptation to the Aerial Maritime Drone Dataset, whose imaging characteristics align with the training data, highlighting the importance of domain-aware training in SR-applications.
Abstract (translated)
生成对抗网络(GANs)在图像超分辨率(SR)方面取得了现实感极强的效果,然而它们缺乏语义一致性与像素级别的信心度,这限制了其在如灾害响应、城市规划和农业等关键遥感应用中的可信度。本文介绍了《语义及不确定性感知的ESRGAN(SU-ESRGAN)》,这是首个专为卫星图像设计的超分辨率框架,该框架融合了ESRGAN模型、通过DeepLabv3实现的分割损失以保留类别细节,并采用蒙特卡洛dropout来生成像素级别的不确定性图。SU-ESRGAN在航拍图像上产生的结果(PSNR,SSIM,LPIPS)与基线ESRGAN相当。 这种新型模型对于使用宽视场(FoV)相机的卫星系统或无人机特别有价值,在这些系统中通常会牺牲空间分辨率以换取覆盖范围。其模块化设计允许在无人机数据管道中进行集成,无论是机载还是后期处理超分辨率任务,都可增强因运动模糊、压缩和传感器限制导致的质量下降的图像。 此外,该模型经过微调来评估其跨域应用性能。测试是在两个基于无人机的数据集上进行的,这两个数据集在海拔高度和成像视角方面有所不同。对于微调后的模型性能评价显示,SU-ESRGAN对与训练数据特征更为匹配的空中海洋无人机数据集具有更强的适应性,这突显了领域感知训练在超分辨率应用中的重要性。
URL
https://arxiv.org/abs/2508.00750