Abstract
Autonomous inspection systems are essential for ensuring the performance and longevity of industrial assets. Recently, agentic frameworks have demonstrated significant potential for automating inspection workflows but have been limited to digital tasks. Their application to physical assets in real-world environments, however, remains underexplored. In this work, our contributions are two-fold: first, we propose a hierarchical agentic framework for autonomous drone control, and second, a reasoning methodology for individual function executions which we refer to as ReActEval. Our framework focuses on visual inspection tasks in indoor industrial settings, such as interpreting industrial readouts or inspecting equipment. It employs a multi-agent system comprising a head agent and multiple worker agents, each controlling a single drone. The head agent performs high-level planning and evaluates outcomes, while worker agents implement ReActEval to reason over and execute low-level actions. Operating entirely in natural language, ReActEval follows a plan, reason, act, evaluate cycle, enabling drones to handle tasks ranging from simple navigation (e.g., flying forward 10 meters and land) to complex high-level tasks (e.g., locating and reading a pressure gauge). The evaluation phase serves as a feedback and/or replanning stage, ensuring actions align with user objectives while preventing undesirable outcomes. We evaluate the framework in a simulated environment with two worker agents, assessing performance qualitatively and quantitatively based on task completion across varying complexity levels and workflow efficiency. By leveraging natural language processing for agent communication, our approach offers a novel, flexible, and user-accessible alternative to traditional drone-based solutions, enabling autonomous problem-solving for industrial inspection without extensive user intervention.
Abstract (translated)
自主检查系统对于确保工业资产的性能和寿命至关重要。最近,代理框架在自动化检查工作流程方面展示了巨大的潜力,但仅限于数字任务。然而,在现实世界环境中将其应用于物理资产的应用却鲜有探索。在这项工作中,我们的贡献包括两个部分:首先,我们提出了一种用于自主无人机控制的分层代理框架;其次,一种称为ReActEval的推理方法,用于个体功能执行。 本框架专注于室内工业环境中的视觉检查任务,例如解读工业读数或检查设备。它采用一个多代理系统,其中包括一个头代理人和多个工人代理人,每个代理人都控制着一架无人机。头代理人进行高层次计划并评估结果,而工人代理人则使用ReActEval来推理和执行低层次的动作。 ReActEval完全基于自然语言工作,遵循规划、推理、行动、评价的循环,使无人机能够处理从简单导航(例如向前飞行10米然后降落)到复杂的高层次任务(如定位和读取压力表)等各种任务。评估阶段作为反馈和/或重新计划的环节,确保动作符合用户目标,并防止不良结果的发生。 我们通过两个工人代理人在模拟环境中对框架进行评估,根据不同复杂度级别的任务完成情况以及工作流程效率从定性和定量两方面来评估其性能表现。 借助自然语言处理实现代理间通信,我们的方法为传统基于无人机的解决方案提供了一种新颖、灵活且用户友好的替代方案,它能够使工业检查中的自主问题解决成为可能,并且无需广泛的用户干预。
URL
https://arxiv.org/abs/2510.00259