Paper Reading AI Learner

A Hierarchical Agentic Framework for Autonomous Drone-Based Visual Inspection

2025-09-30 20:31:30
Ethan Herron, Xian Yeow Lee, Gregory Sin, Teresa Gonzalez Diaz, Ahmed Farahat, Chetan Gupta

Abstract

Autonomous inspection systems are essential for ensuring the performance and longevity of industrial assets. Recently, agentic frameworks have demonstrated significant potential for automating inspection workflows but have been limited to digital tasks. Their application to physical assets in real-world environments, however, remains underexplored. In this work, our contributions are two-fold: first, we propose a hierarchical agentic framework for autonomous drone control, and second, a reasoning methodology for individual function executions which we refer to as ReActEval. Our framework focuses on visual inspection tasks in indoor industrial settings, such as interpreting industrial readouts or inspecting equipment. It employs a multi-agent system comprising a head agent and multiple worker agents, each controlling a single drone. The head agent performs high-level planning and evaluates outcomes, while worker agents implement ReActEval to reason over and execute low-level actions. Operating entirely in natural language, ReActEval follows a plan, reason, act, evaluate cycle, enabling drones to handle tasks ranging from simple navigation (e.g., flying forward 10 meters and land) to complex high-level tasks (e.g., locating and reading a pressure gauge). The evaluation phase serves as a feedback and/or replanning stage, ensuring actions align with user objectives while preventing undesirable outcomes. We evaluate the framework in a simulated environment with two worker agents, assessing performance qualitatively and quantitatively based on task completion across varying complexity levels and workflow efficiency. By leveraging natural language processing for agent communication, our approach offers a novel, flexible, and user-accessible alternative to traditional drone-based solutions, enabling autonomous problem-solving for industrial inspection without extensive user intervention.

Abstract (translated)

自主检查系统对于确保工业资产的性能和寿命至关重要。最近,代理框架在自动化检查工作流程方面展示了巨大的潜力,但仅限于数字任务。然而,在现实世界环境中将其应用于物理资产的应用却鲜有探索。在这项工作中,我们的贡献包括两个部分:首先,我们提出了一种用于自主无人机控制的分层代理框架;其次,一种称为ReActEval的推理方法,用于个体功能执行。 本框架专注于室内工业环境中的视觉检查任务,例如解读工业读数或检查设备。它采用一个多代理系统,其中包括一个头代理人和多个工人代理人,每个代理人都控制着一架无人机。头代理人进行高层次计划并评估结果,而工人代理人则使用ReActEval来推理和执行低层次的动作。 ReActEval完全基于自然语言工作,遵循规划、推理、行动、评价的循环,使无人机能够处理从简单导航(例如向前飞行10米然后降落)到复杂的高层次任务(如定位和读取压力表)等各种任务。评估阶段作为反馈和/或重新计划的环节,确保动作符合用户目标,并防止不良结果的发生。 我们通过两个工人代理人在模拟环境中对框架进行评估,根据不同复杂度级别的任务完成情况以及工作流程效率从定性和定量两方面来评估其性能表现。 借助自然语言处理实现代理间通信,我们的方法为传统基于无人机的解决方案提供了一种新颖、灵活且用户友好的替代方案,它能够使工业检查中的自主问题解决成为可能,并且无需广泛的用户干预。

URL

https://arxiv.org/abs/2510.00259

PDF

https://arxiv.org/pdf/2510.00259.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot