Paper Reading AI Learner

Learned Controllers for Agile Quadrotors in Pursuit-Evasion Games

2025-06-03 13:19:23
Alejandro Sanchez Roncero, Olov Andersson, Petter Ogren

Abstract

The increasing proliferation of small UAVs in civilian and military airspace has raised critical safety and security concerns, especially when unauthorized or malicious drones enter restricted zones. In this work, we present a reinforcement learning (RL) framework for agile 1v1 quadrotor pursuit-evasion. We train neural network policies to command body rates and collective thrust, enabling high-speed pursuit and evasive maneuvers that fully exploit the quadrotor's nonlinear dynamics. To mitigate nonstationarity and catastrophic forgetting during adversarial co-training, we introduce an Asynchronous Multi-Stage Population-Based (AMSPB) algorithm where, at each stage, either the pursuer or evader learns against a sampled opponent drawn from a growing population of past and current policies. This continual learning setup ensures monotonic performance improvement and retention of earlier strategies. Our results show that (i) rate-based policies achieve significantly higher capture rates and peak speeds than velocity-level baselines, and (ii) AMSPB yields stable, monotonic gains against a suite of benchmark opponents.

Abstract (translated)

民用和军事空域中小型无人机的日益普及引发了重要的安全和安保问题,尤其是当未经授权或恶意操作的无人机进入受限区域时。在这项工作中,我们提出了一种用于敏捷1v1四旋翼追逐与逃避的强化学习(RL)框架。我们训练神经网络策略来指挥机体速率和总推力,使高速追踪和规避动作能够充分利用四旋翼的非线性动态特性。 为了在对抗性协同训练中缓解非平稳性和灾难性遗忘问题,我们引入了一种异步多阶段群体基础算法(AMSPB),其中,在每个阶段,追击者或逃避者都会针对从过去和当前策略组成的不断扩大的群体中随机抽取的对手进行学习。这种持续学习设置确保了性能的单调改进,并保留了早期策略。 我们的实验结果表明:(i)基于速率的政策实现了比速度级基准显著更高的捕捉率和峰值速度;(ii)AMSPB算法对一系列基准对手产生了稳定且单调的收益。

URL

https://arxiv.org/abs/2506.02849

PDF

https://arxiv.org/pdf/2506.02849.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot