Paper Reading AI Learner

Synthetic vs. Real Training Data for Visual Navigation

2025-09-15 11:22:40
Lauri Suomela, Sasanka Kuruppu Arachchige, German F. Torres, Harry Edelman, Joni-Kristian K\"am\"ar\"ainen

Abstract

This paper investigates how the performance of visual navigation policies trained in simulation compares to policies trained with real-world data. Performance degradation of simulator-trained policies is often significant when they are evaluated in the real world. However, despite this well-known sim-to-real gap, we demonstrate that simulator-trained policies can match the performance of their real-world-trained counterparts. Central to our approach is a navigation policy architecture that bridges the sim-to-real appearance gap by leveraging pretrained visual representations and runs real-time on robot hardware. Evaluations on a wheeled mobile robot show that the proposed policy, when trained in simulation, outperforms its real-world-trained version by 31% and the prior state-of-the-art methods by 50% in navigation success rate. Policy generalization is verified by deploying the same model onboard a drone. Our results highlight the importance of diverse image encoder pretraining for sim-to-real generalization, and identify on-policy learning as a key advantage of simulated training over training with real data.

Abstract (translated)

本文研究了在模拟环境中训练的视觉导航策略与使用真实世界数据训练的策略之间的性能比较。通常,当从模拟器中训练出来的策略被评估在现实世界时,其性能会显著下降。然而,尽管存在这种众所周知的“仿真到实际”差距,我们证明了通过特定方法,可以从模拟器中训练出的策略可以与使用真实数据训练出的策略达到相同的性能水平。 我们的方法核心在于一种导航政策架构,该架构利用预先训练好的视觉表示来弥补模拟环境和现实世界的外观差异,并且能够在机器人硬件上实时运行。在一台轮式移动机器人的评估显示,在模拟环境中训练的提议策略比同样模型使用真实数据训练的版本高出31%的成功率,同时比之前的最先进的方法提高了50%的导航成功率。 该政策的泛化能力通过将其部署到无人机上来验证。我们的研究结果强调了多样化的图像编码器预训练对于从仿真到实际环境中的一般化的重要性,并且指出基于策略的学习是模拟训练相对于使用真实数据训练的关键优势。

URL

https://arxiv.org/abs/2509.11791

PDF

https://arxiv.org/pdf/2509.11791.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot