Paper Reading AI Learner

SU-ESRGAN: Semantic and Uncertainty-Aware ESRGAN for Super-Resolution of Satellite and Drone Imagery with Fine-Tuning for Cross Domain Evaluation

2025-08-01 16:25:21
Prerana Ramkumar

Abstract

Generative Adversarial Networks (GANs) have achieved realistic super-resolution (SR) of images however, they lack semantic consistency and per-pixel confidence, limiting their credibility in critical remote sensing applications such as disaster response, urban planning and agriculture. This paper introduces Semantic and Uncertainty-Aware ESRGAN (SU-ESRGAN), the first SR framework designed for satellite imagery to integrate the ESRGAN, segmentation loss via DeepLabv3 for class detail preservation and Monte Carlo dropout to produce pixel-wise uncertainty maps. The SU-ESRGAN produces results (PSNR, SSIM, LPIPS) comparable to the Baseline ESRGAN on aerial imagery. This novel model is valuable in satellite systems or UAVs that use wide field-of-view (FoV) cameras, trading off spatial resolution for coverage. The modular design allows integration in UAV data pipelines for on-board or post-processing SR to enhance imagery resulting due to motion blur, compression and sensor limitations. Further, the model is fine-tuned to evaluate its performance on cross domain applications. The tests are conducted on two drone based datasets which differ in altitude and imaging perspective. Performance evaluation of the fine-tuned models show a stronger adaptation to the Aerial Maritime Drone Dataset, whose imaging characteristics align with the training data, highlighting the importance of domain-aware training in SR-applications.

Abstract (translated)

生成对抗网络(GANs)在图像超分辨率(SR)方面取得了现实感极强的效果,然而它们缺乏语义一致性与像素级别的信心度,这限制了其在如灾害响应、城市规划和农业等关键遥感应用中的可信度。本文介绍了《语义及不确定性感知的ESRGAN(SU-ESRGAN)》,这是首个专为卫星图像设计的超分辨率框架,该框架融合了ESRGAN模型、通过DeepLabv3实现的分割损失以保留类别细节,并采用蒙特卡洛dropout来生成像素级别的不确定性图。SU-ESRGAN在航拍图像上产生的结果(PSNR,SSIM,LPIPS)与基线ESRGAN相当。 这种新型模型对于使用宽视场(FoV)相机的卫星系统或无人机特别有价值,在这些系统中通常会牺牲空间分辨率以换取覆盖范围。其模块化设计允许在无人机数据管道中进行集成,无论是机载还是后期处理超分辨率任务,都可增强因运动模糊、压缩和传感器限制导致的质量下降的图像。 此外,该模型经过微调来评估其跨域应用性能。测试是在两个基于无人机的数据集上进行的,这两个数据集在海拔高度和成像视角方面有所不同。对于微调后的模型性能评价显示,SU-ESRGAN对与训练数据特征更为匹配的空中海洋无人机数据集具有更强的适应性,这突显了领域感知训练在超分辨率应用中的重要性。

URL

https://arxiv.org/abs/2508.00750

PDF

https://arxiv.org/pdf/2508.00750.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot