Abstract
Autonomous drone navigation in confined tubular environments remains a major challenge due to the constraining geometry of the conduits, the proximity of the walls, and the perceptual limitations inherent to such scenarios. We propose a reinforcement learning approach enabling a drone to navigate unknown three-dimensional tubes without any prior knowledge of their geometry, relying solely on local observations from LiDAR and a conditional visual detection of the tube center. In contrast, the Pure Pursuit algorithm, used as a deterministic baseline, benefits from explicit access to the centerline, creating an information asymmetry designed to assess the ability of RL to compensate for the absence of a geometric model. The agent is trained through a progressive Curriculum Learning strategy that gradually exposes it to increasingly curved geometries, where the tube center frequently disappears from the visual field. A turning-negotiation mechanism, based on the combination of direct visibility, directional memory, and LiDAR symmetry cues, proves essential for ensuring stable navigation under such partial observability conditions. Experiments show that the PPO policy acquires robust and generalizable behavior, consistently outperforming the deterministic controller despite its limited access to geometric information. Validation in a high-fidelity 3D environment further confirms the transferability of the learned behavior to a continuous physical dynamics. The proposed approach thus provides a complete framework for autonomous navigation in unknown tubular environments and opens perspectives for industrial, underground, or medical applications where progressing through narrow and weakly perceptive conduits represents a central challenge.
Abstract (translated)
在受限的管状环境中,自主无人机导航仍然是一个重大挑战,这主要是由于管道几何结构的限制、墙壁间的距离以及这种场景中固有的感知限制。我们提出了一种强化学习方法,使无人机能够在没有管道几何知识的情况下仅通过LiDAR(激光雷达)的局部观测和条件视觉检测来探测管中心而进行未知三维管道内的导航。相比之下,作为确定性基准算法的纯追踪(Pure Pursuit)算法则可以明确访问到管道的中心线,这种信息不对称的设计旨在评估强化学习在没有几何模型的情况下补偿的能力。 通过渐进式课程学习策略对代理进行训练,该策略逐渐将其暴露于越来越弯曲的几何形状中,在此过程中管子中心经常从视觉区域消失。一种基于直接可见性、方向记忆和LiDAR(激光雷达)对称提示相结合的转弯协商机制被证明是确保在部分观察条件下稳定导航的关键。 实验表明,PPO(Proximal Policy Optimization,近端策略优化)政策能够获得稳健且具有泛化能力的行为,在几何信息有限的情况下依然优于确定性控制器。在一个高保真的3D环境中进行验证进一步确认了所学行为向连续物理动力学的可转移性。 因此,该方法提供了一个完整的自主导航框架以应对未知管状环境中的挑战,并为工业、地下或医疗应用中穿过狭窄且感知受限的管道这一核心问题打开了新的视角。
URL
https://arxiv.org/abs/2512.10934