Abstract
Autonomous drones must often respond to sudden events, such as alarms, faults, or unexpected changes in their environment, that require immediate and adaptive decision-making. Traditional approaches rely on safety engineers hand-coding large sets of recovery rules, but this strategy cannot anticipate the vast range of real-world contingencies and quickly becomes incomplete. Recent advances in embodied AI, powered by large visual language models, provide commonsense reasoning to assess context and generate appropriate actions in real time. We demonstrate this capability in a simulated urban benchmark in the Unreal Engine, where drones dynamically interpret their surroundings and decide on sudden maneuvers for safe landings. Our results show that embodied AI makes possible a new class of adaptive recovery and decision-making pipelines that were previously infeasible to design by hand, advancing resilience and safety in autonomous aerial systems.
Abstract (translated)
自主无人机常常需要应对突然事件,如警报、故障或环境中的意外变化,这些情况要求即时和适应性的决策。传统方法依赖于安全工程师手动编写大量的恢复规则,但这种方法无法预测现实世界中广泛多样的突发状况,并且很快就会变得不完整。近年来,基于大型视觉语言模型的具身人工智能(Embodied AI)的进步提供了常识推理能力,能够评估环境并实时生成适当的行动。我们在虚幻引擎中的模拟城市基准测试中展示了这种能力,无人机可以动态地解释周围的环境并在需要时做出突然的机动以确保安全着陆。我们的研究结果表明,具身AI使得设计以前难以手动实现的新一代适应性恢复和决策流程成为可能,从而提升了自主空中系统的弹性和安全性。
URL
https://arxiv.org/abs/2510.00167