Paper Reading AI Learner

Curriculum-Based Reinforcement Learning for Autonomous UAV Navigation in Unknown Curved Tubular Conduit

2025-12-11 18:57:29
Zamirddine Mari, J\'er\^ome Pasquet, Julien Seinturier

Abstract

Autonomous drone navigation in confined tubular environments remains a major challenge due to the constraining geometry of the conduits, the proximity of the walls, and the perceptual limitations inherent to such scenarios. We propose a reinforcement learning approach enabling a drone to navigate unknown three-dimensional tubes without any prior knowledge of their geometry, relying solely on local observations from LiDAR and a conditional visual detection of the tube center. In contrast, the Pure Pursuit algorithm, used as a deterministic baseline, benefits from explicit access to the centerline, creating an information asymmetry designed to assess the ability of RL to compensate for the absence of a geometric model. The agent is trained through a progressive Curriculum Learning strategy that gradually exposes it to increasingly curved geometries, where the tube center frequently disappears from the visual field. A turning-negotiation mechanism, based on the combination of direct visibility, directional memory, and LiDAR symmetry cues, proves essential for ensuring stable navigation under such partial observability conditions. Experiments show that the PPO policy acquires robust and generalizable behavior, consistently outperforming the deterministic controller despite its limited access to geometric information. Validation in a high-fidelity 3D environment further confirms the transferability of the learned behavior to a continuous physical dynamics. The proposed approach thus provides a complete framework for autonomous navigation in unknown tubular environments and opens perspectives for industrial, underground, or medical applications where progressing through narrow and weakly perceptive conduits represents a central challenge.

Abstract (translated)

在受限的管状环境中,自主无人机导航仍然是一个重大挑战,这主要是由于管道几何结构的限制、墙壁间的距离以及这种场景中固有的感知限制。我们提出了一种强化学习方法,使无人机能够在没有管道几何知识的情况下仅通过LiDAR(激光雷达)的局部观测和条件视觉检测来探测管中心而进行未知三维管道内的导航。相比之下,作为确定性基准算法的纯追踪(Pure Pursuit)算法则可以明确访问到管道的中心线,这种信息不对称的设计旨在评估强化学习在没有几何模型的情况下补偿的能力。 通过渐进式课程学习策略对代理进行训练,该策略逐渐将其暴露于越来越弯曲的几何形状中,在此过程中管子中心经常从视觉区域消失。一种基于直接可见性、方向记忆和LiDAR(激光雷达)对称提示相结合的转弯协商机制被证明是确保在部分观察条件下稳定导航的关键。 实验表明,PPO(Proximal Policy Optimization,近端策略优化)政策能够获得稳健且具有泛化能力的行为,在几何信息有限的情况下依然优于确定性控制器。在一个高保真的3D环境中进行验证进一步确认了所学行为向连续物理动力学的可转移性。 因此,该方法提供了一个完整的自主导航框架以应对未知管状环境中的挑战,并为工业、地下或医疗应用中穿过狭窄且感知受限的管道这一核心问题打开了新的视角。

URL

https://arxiv.org/abs/2512.10934

PDF

https://arxiv.org/pdf/2512.10934.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot