Abstract
Small Uncrewed Aerial Systems (sUAS) are increasingly deployed as autonomous swarms in search-and-rescue and other disaster-response scenarios. In these settings, they use computer vision (CV) to detect objects of interest and autonomously adapt their missions. However, traditional CV systems often struggle to recognize unfamiliar objects in open-world environments or to infer their relevance for mission planning. To address this, we incorporate large language models (LLMs) to reason about detected objects and their implications. While LLMs can offer valuable insights, they are also prone to hallucinations and may produce incorrect, misleading, or unsafe recommendations. To ensure safe and sensible decision-making under uncertainty, high-level decisions must be governed by cognitive guardrails. This article presents the design, simulation, and real-world integration of these guardrails for sUAS swarms in search-and-rescue missions.
Abstract (translated)
小型无人飞行系统(sUAS)在搜索和救援以及其他灾害应对场景中越来越多地被部署为自主集群。在这种情况下,它们使用计算机视觉(CV)来检测感兴趣的物体并自动调整其任务计划。然而,传统的CV系统往往难以识别开放环境中的不熟悉的物体或推断这些物体对任务规划的相关性。为此,我们引入了大型语言模型(LLMs),以针对检测到的物体进行推理并评估它们的意义。尽管LLMs可以提供宝贵的见解,但它们也容易产生幻觉,并可能生成错误、误导性的甚至危险的建议。为了在不确定性条件下确保安全和合理的决策制定,必须通过认知护栏来规范高层决策。本文介绍了为搜索和救援任务中的sUAS集群设计、模拟和实际集成这些认知护栏的方法。
URL
https://arxiv.org/abs/2505.23576