Paper Reading AI Learner

FM-Planner: Foundation Model Guided Path Planning for Autonomous Drone Navigation

2025-05-27 06:41:21
Jiaping Xiao, Cheng Wen Tsao, Yuhang Zhang, Mir Feroskhan

Abstract

Path planning is a critical component in autonomous drone operations, enabling safe and efficient navigation through complex environments. Recent advances in foundation models, particularly large language models (LLMs) and vision-language models (VLMs), have opened new opportunities for enhanced perception and intelligent decision-making in robotics. However, their practical applicability and effectiveness in global path planning remain relatively unexplored. This paper proposes foundation model-guided path planners (FM-Planner) and presents a comprehensive benchmarking study and practical validation for drone path planning. Specifically, we first systematically evaluate eight representative LLM and VLM approaches using standardized simulation scenarios. To enable effective real-time navigation, we then design an integrated LLM-Vision planner that combines semantic reasoning with visual perception. Furthermore, we deploy and validate the proposed path planner through real-world experiments under multiple configurations. Our findings provide valuable insights into the strengths, limitations, and feasibility of deploying foundation models in real-world drone applications and providing practical implementations in autonomous flight. Project site: this https URL.

Abstract (translated)

路径规划是自主无人机操作中的关键组成部分,它能够使无人机在复杂环境中实现安全和高效的导航。近年来,在基础模型领域,尤其是大规模语言模型(LLMs)和视觉-语言模型(VLMs)方面取得了显著进展,这些进步为机器人技术提供了增强感知能力和智能决策的新机会。然而,这些模型在全球路径规划中的实际适用性和有效性仍然相对未被充分探索。 本文提出了一种由基础模型引导的路径规划器(FM-Planner),并进行了全面的基准测试研究和实践验证以应用于无人机路径规划中。具体而言,我们首先使用标准化仿真场景对八种代表性的LLM和VLM方法进行全面评估。为了实现有效的实时导航,我们设计了一个集成的语言模型-视觉规划器,该规划器结合了语义推理与视觉感知能力。此外,我们在多种配置下通过实际实验部署并验证了所提出的路径规划方案。 我们的研究结果为将基础模型应用于现实世界中的无人机应用提供了宝贵见解,并展示了其在自主飞行中实现的实用实施方案的有效性、局限性和可行性。项目网站:[此URL](https://this-url.com)。

URL

https://arxiv.org/abs/2505.20783

PDF

https://arxiv.org/pdf/2505.20783.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot