Abstract
Quadrotors have demonstrated remarkable versatility, yet their full aerobatic potential remains largely untapped due to inherent underactuation and the complexity of aggressive maneuvers. Traditional approaches, separating trajectory optimization and tracking control, suffer from tracking inaccuracies, computational latency, and sensitivity to initial conditions, limiting their effectiveness in dynamic, high-agility scenarios. Inspired by recent breakthroughs in data-driven methods, we propose a reinforcement learning-based framework that directly maps drone states and aerobatic intentions to control commands, eliminating modular separation to enable quadrotors to perform end-to-end policy optimization for extreme aerobatic maneuvers. To ensure efficient and stable training, we introduce an automated curriculum learning strategy that dynamically adjusts aerobatic task difficulty. Enabled by domain randomization for robust zero-shot sim-to-real transfer, our approach is validated in demanding real-world experiments, including the first demonstration of a drone autonomously performing continuous inverted flight while reactively navigating a moving gate, showcasing unprecedented agility.
Abstract (translated)
四旋翼飞行器展示了非凡的灵活性,但由于固有的欠驱动特性和复杂剧烈机动操作的难度,其全面的特技飞行潜力尚未充分发挥。传统的分离轨迹优化和跟踪控制的方法受到跟踪不准确、计算延迟以及对初始条件敏感性的影响,在动态和高敏捷度场景中的效果受到了限制。受最近数据驱动方法突破的启发,我们提出了一种基于强化学习框架的方法,该方法直接将无人机状态与特技意图映射到控制命令上,消除了模块化分离,使四旋翼能够进行端到端策略优化以执行极端特技飞行动作。 为了确保高效和稳定的训练过程,我们引入了自动化的课程学习策略,可以动态调整特技任务的难度。借助领域随机化技术实现鲁棒的零样本仿真至现实转换能力,我们的方法在严格的实际环境中进行了验证,包括首次演示无人机自主完成连续倒飞并主动导航通过移动门的任务,展现了前所未有的敏捷性。
URL
https://arxiv.org/abs/2505.24396