Paper Reading AI Learner

Structural Damage Detection Using AI Super Resolution and Visual Language Model

2025-08-23 20:12:06
Catherine Hoier, Khandaker Mamun Ahmed

Abstract

Natural disasters pose significant challenges to timely and accurate damage assessment due to their sudden onset and the extensive areas they affect. Traditional assessment methods are often labor-intensive, costly, and hazardous to personnel, making them impractical for rapid response, especially in resource-limited settings. This study proposes a novel, cost-effective framework that leverages aerial drone footage, an advanced AI-based video super-resolution model, Video Restoration Transformer (VRT), and Gemma3:27b, a 27 billion parameter Visual Language Model (VLM). This integrated system is designed to improve low-resolution disaster footage, identify structural damage, and classify buildings into four damage categories, ranging from no/slight damage to total destruction, along with associated risk levels. The methodology was validated using pre- and post-event drone imagery from the 2023 Turkey earthquakes (courtesy of The Guardian) and satellite data from the 2013 Moore Tornado (xBD dataset). The framework achieved a classification accuracy of 84.5%, demonstrating its ability to provide highly accurate results. Furthermore, the system's accessibility allows non-technical users to perform preliminary analyses, thereby improving the responsiveness and efficiency of disaster management efforts.

Abstract (translated)

自然灾害的发生给及时和准确的灾害评估带来了重大挑战,因为它们往往突然发生且影响范围广泛。传统的评估方法通常耗时费力、成本高昂,并且对人员构成安全隐患,在资源有限的情况下难以迅速应对。本研究提出了一种新颖且经济高效的框架,该框架利用无人机空中拍摄视频、先进的AI视频超分辨率模型——Video Restoration Transformer(VRT),以及Gemma3:27b这一拥有270亿参数的视觉语言模型(VLM)。这套集成系统旨在改进低质量的灾害视频画面,识别结构损坏,并将建筑物分类为四个损伤等级,从轻微到完全破坏,并关联相应的风险级别。该方法使用了土耳其2023年地震事件前后拍摄的无人机影像资料(由The Guardian提供)和2013年美国摩尔龙卷风的卫星数据(xBD数据集)进行了验证。测试结果显示,框架在分类准确性上达到了84.5%,证明其能够提供高度准确的结果。此外,该系统的易用性使非技术人员也能进行初步分析,从而提高灾害管理工作的响应速度和效率。

URL

https://arxiv.org/abs/2508.17130

PDF

https://arxiv.org/pdf/2508.17130.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot