Paper Reading AI Learner

VLA-AN: An Efficient and Onboard Vision-Language-Action Framework for Aerial Navigation in Complex Environments

2025-12-17 10:02:55
Yuze Wu, Mo Zhu, Xingxing Li, Yuheng Du, Yuxin Fan, Wenjun Li, Xin Zhou, Fei Gao

Abstract

This paper proposes VLA-AN, an efficient and onboard Vision-Language-Action (VLA) framework dedicated to autonomous drone navigation in complex environments. VLA-AN addresses four major limitations of existing large aerial navigation models: the data domain gap, insufficient temporal navigation with reasoning, safety issues with generative action policies, and onboard deployment constraints. First, we construct a high-fidelity dataset utilizing 3D Gaussian Splatting (3D-GS) to effectively bridge the domain gap. Second, we introduce a progressive three-stage training framework that sequentially reinforces scene comprehension, core flight skills, and complex navigation capabilities. Third, we design a lightweight, real-time action module coupled with geometric safety correction. This module ensures fast, collision-free, and stable command generation, mitigating the safety risks inherent in stochastic generative policies. Finally, through deep optimization of the onboard deployment pipeline, VLA-AN achieves a robust real-time 8.3x improvement in inference throughput on resource-constrained UAVs. Extensive experiments demonstrate that VLA-AN significantly improves spatial grounding, scene reasoning, and long-horizon navigation, achieving a maximum single-task success rate of 98.1%, and providing an efficient, practical solution for realizing full-chain closed-loop autonomy in lightweight aerial robots.

Abstract (translated)

本文提出了VLA-AN,这是一种高效且适合自主无人机在复杂环境中导航的视觉-语言-行动(Vision-Language-Action,简称VLA)框架。VLA-AN解决了现有大型空中导航模型面临的四大主要限制:数据领域差距、时间推理不足的导航问题、生成性行动策略的安全隐患以及机载部署的约束条件。具体来说: 首先,我们构建了一个高保真的数据集,采用3D高斯点画(3D Gaussian Splatting, 3D-GS)技术,有效地缩小了数据领域的差距。 其次,我们提出了一种渐进式的三阶段训练框架,该框架依次强化场景理解、核心飞行技能以及复杂导航能力的培养。 第三,我们设计了一个轻量级且实时的动作模块,并结合了几何安全校正。这一模块确保了快速生成无碰撞且稳定的指令,降低了随机性生成策略带来的固有安全性风险。 最后,通过深入优化机载部署管道,VLA-AN在资源受限的无人机上实现了8.3倍的强大实时推理吞吐量提升。 广泛的实验表明,与现有模型相比,VLA-AN显著提高了空间定位、场景理解以及长时展望导航的能力,并且单任务成功率最高可达98.1%。此外,它还为轻型空中机器人实现全链闭环自主提供了一个高效和实用的解决方案。

URL

https://arxiv.org/abs/2512.15258

PDF

https://arxiv.org/pdf/2512.15258.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot