Abstract
Path planning is a critical component in autonomous drone operations, enabling safe and efficient navigation through complex environments. Recent advances in foundation models, particularly large language models (LLMs) and vision-language models (VLMs), have opened new opportunities for enhanced perception and intelligent decision-making in robotics. However, their practical applicability and effectiveness in global path planning remain relatively unexplored. This paper proposes foundation model-guided path planners (FM-Planner) and presents a comprehensive benchmarking study and practical validation for drone path planning. Specifically, we first systematically evaluate eight representative LLM and VLM approaches using standardized simulation scenarios. To enable effective real-time navigation, we then design an integrated LLM-Vision planner that combines semantic reasoning with visual perception. Furthermore, we deploy and validate the proposed path planner through real-world experiments under multiple configurations. Our findings provide valuable insights into the strengths, limitations, and feasibility of deploying foundation models in real-world drone applications and providing practical implementations in autonomous flight. Project site: this https URL.
Abstract (translated)
路径规划是自主无人机操作中的关键组成部分,它能够使无人机在复杂环境中实现安全和高效的导航。近年来,在基础模型领域,尤其是大规模语言模型(LLMs)和视觉-语言模型(VLMs)方面取得了显著进展,这些进步为机器人技术提供了增强感知能力和智能决策的新机会。然而,这些模型在全球路径规划中的实际适用性和有效性仍然相对未被充分探索。 本文提出了一种由基础模型引导的路径规划器(FM-Planner),并进行了全面的基准测试研究和实践验证以应用于无人机路径规划中。具体而言,我们首先使用标准化仿真场景对八种代表性的LLM和VLM方法进行全面评估。为了实现有效的实时导航,我们设计了一个集成的语言模型-视觉规划器,该规划器结合了语义推理与视觉感知能力。此外,我们在多种配置下通过实际实验部署并验证了所提出的路径规划方案。 我们的研究结果为将基础模型应用于现实世界中的无人机应用提供了宝贵见解,并展示了其在自主飞行中实现的实用实施方案的有效性、局限性和可行性。项目网站:[此URL](https://this-url.com)。
URL
https://arxiv.org/abs/2505.20783