Abstract
Most reinforcement learning(RL)-based methods for drone racing target fixed, obstacle-free tracks, leaving the generalization to unknown, cluttered environments largely unaddressed. This challenge stems from the need to balance racing speed and collision avoidance, limited feasible space causing policy exploration trapped in local optima during training, and perceptual ambiguity between gates and obstacles in depth maps-especially when gate positions are only coarsely specified. To overcome these issues, we propose a two-phase learning framework: an initial soft-collision training phase that preserves policy exploration for high-speed flight, followed by a hard-collision refinement phase that enforces robust obstacle avoidance. An adaptive, noise-augmented curriculum with an asymmetric actor-critic architecture gradually shifts the policy's reliance from privileged gate-state information to depth-based visual input. We further impose Lipschitz constraints and integrate a track-primitive generator to enhance motion stability and cross-environment generalization. We evaluate our framework through extensive simulation and ablation studies, and validate it in real-world experiments on a computationally constrained quadrotor. The system achieves agile flight while remaining robust to gate-position errors, developing a generalizable drone racing framework with the capability to operate in diverse, partially unknown and cluttered environments. this https URL
Abstract (translated)
大多数基于强化学习(RL)的无人机竞速方法都针对固定且无障碍物的比赛轨道,对未知和复杂环境中的泛化能力几乎没有涉及。这一挑战源于需要平衡飞行速度与碰撞规避、受限的空间导致在训练过程中策略探索陷入局部最优解以及深度图中门和障碍物之间的感知模糊——特别是在门位置仅粗略指定的情况下尤为严重。 为了克服这些问题,我们提出了一种两阶段学习框架:初始的软碰撞训练阶段,在该阶段中保持了高速飞行中的策略探索;接着是一个硬碰撞细化阶段,强制执行稳健的障碍规避。一个自适应、噪声增强的教学大纲与不对称的演员-评论家架构相结合,逐渐让策略依赖从特权门状态信息转向基于深度视觉输入的信息。 我们进一步施加利普希茨(Lipschitz)约束并整合轨道元素生成器以提高运动稳定性以及跨环境泛化能力。通过广泛的仿真和消融研究对我们的框架进行了评估,并在计算资源有限的四旋翼无人机上进行实际验证实验,证明了该系统的有效性。 最终系统能够在保持鲁棒性的同时实现敏捷飞行,对于门位置误差具有良好的适应性,从而开发出一种通用化的无人机竞速框架,具备在多变、部分未知和拥挤环境中操作的能力。详情请参阅[原文链接]。
URL
https://arxiv.org/abs/2512.09571