Paper Reading AI Learner

Mastering Diverse, Unknown, and Cluttered Tracks for Robust Vision-Based Drone Racing

2025-12-10 12:02:48
Feng Yu, Yu Hu, Yang Su, Yang Deng, Linzuo Zhang, Danping Zou

Abstract

Most reinforcement learning(RL)-based methods for drone racing target fixed, obstacle-free tracks, leaving the generalization to unknown, cluttered environments largely unaddressed. This challenge stems from the need to balance racing speed and collision avoidance, limited feasible space causing policy exploration trapped in local optima during training, and perceptual ambiguity between gates and obstacles in depth maps-especially when gate positions are only coarsely specified. To overcome these issues, we propose a two-phase learning framework: an initial soft-collision training phase that preserves policy exploration for high-speed flight, followed by a hard-collision refinement phase that enforces robust obstacle avoidance. An adaptive, noise-augmented curriculum with an asymmetric actor-critic architecture gradually shifts the policy's reliance from privileged gate-state information to depth-based visual input. We further impose Lipschitz constraints and integrate a track-primitive generator to enhance motion stability and cross-environment generalization. We evaluate our framework through extensive simulation and ablation studies, and validate it in real-world experiments on a computationally constrained quadrotor. The system achieves agile flight while remaining robust to gate-position errors, developing a generalizable drone racing framework with the capability to operate in diverse, partially unknown and cluttered environments. this https URL

Abstract (translated)

大多数基于强化学习(RL)的无人机竞速方法都针对固定且无障碍物的比赛轨道,对未知和复杂环境中的泛化能力几乎没有涉及。这一挑战源于需要平衡飞行速度与碰撞规避、受限的空间导致在训练过程中策略探索陷入局部最优解以及深度图中门和障碍物之间的感知模糊——特别是在门位置仅粗略指定的情况下尤为严重。 为了克服这些问题,我们提出了一种两阶段学习框架:初始的软碰撞训练阶段,在该阶段中保持了高速飞行中的策略探索;接着是一个硬碰撞细化阶段,强制执行稳健的障碍规避。一个自适应、噪声增强的教学大纲与不对称的演员-评论家架构相结合,逐渐让策略依赖从特权门状态信息转向基于深度视觉输入的信息。 我们进一步施加利普希茨(Lipschitz)约束并整合轨道元素生成器以提高运动稳定性以及跨环境泛化能力。通过广泛的仿真和消融研究对我们的框架进行了评估,并在计算资源有限的四旋翼无人机上进行实际验证实验,证明了该系统的有效性。 最终系统能够在保持鲁棒性的同时实现敏捷飞行,对于门位置误差具有良好的适应性,从而开发出一种通用化的无人机竞速框架,具备在多变、部分未知和拥挤环境中操作的能力。详情请参阅[原文链接]。

URL

https://arxiv.org/abs/2512.09571

PDF

https://arxiv.org/pdf/2512.09571.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot