Abstract
This paper investigates how the performance of visual navigation policies trained in simulation compares to policies trained with real-world data. Performance degradation of simulator-trained policies is often significant when they are evaluated in the real world. However, despite this well-known sim-to-real gap, we demonstrate that simulator-trained policies can match the performance of their real-world-trained counterparts. Central to our approach is a navigation policy architecture that bridges the sim-to-real appearance gap by leveraging pretrained visual representations and runs real-time on robot hardware. Evaluations on a wheeled mobile robot show that the proposed policy, when trained in simulation, outperforms its real-world-trained version by 31% and the prior state-of-the-art methods by 50% in navigation success rate. Policy generalization is verified by deploying the same model onboard a drone. Our results highlight the importance of diverse image encoder pretraining for sim-to-real generalization, and identify on-policy learning as a key advantage of simulated training over training with real data.
Abstract (translated)
本文研究了在模拟环境中训练的视觉导航策略与使用真实世界数据训练的策略之间的性能比较。通常,当从模拟器中训练出来的策略被评估在现实世界时,其性能会显著下降。然而,尽管存在这种众所周知的“仿真到实际”差距,我们证明了通过特定方法,可以从模拟器中训练出的策略可以与使用真实数据训练出的策略达到相同的性能水平。 我们的方法核心在于一种导航政策架构,该架构利用预先训练好的视觉表示来弥补模拟环境和现实世界的外观差异,并且能够在机器人硬件上实时运行。在一台轮式移动机器人的评估显示,在模拟环境中训练的提议策略比同样模型使用真实数据训练的版本高出31%的成功率,同时比之前的最先进的方法提高了50%的导航成功率。 该政策的泛化能力通过将其部署到无人机上来验证。我们的研究结果强调了多样化的图像编码器预训练对于从仿真到实际环境中的一般化的重要性,并且指出基于策略的学习是模拟训练相对于使用真实数据训练的关键优势。
URL
https://arxiv.org/abs/2509.11791