Abstract
Datasets are essential to train and evaluate computer vision models used for traffic analysis and to enhance road safety. Existing real datasets fit real-world scenarios, capturing authentic road object behaviors, however, they typically lack precise ground-truth annotations. In contrast, synthetic datasets play a crucial role, allowing for the annotation of a large number of frames without additional costs or extra time. However, a general drawback of synthetic datasets is the lack of realistic vehicle motion, since trajectories are generated using AI models or rule-based systems. In this work, we introduce R3ST (Realistic 3D Synthetic Trajectories), a synthetic dataset that overcomes this limitation by generating a synthetic 3D environment and integrating real-world trajectories derived from SinD, a bird's-eye-view dataset recorded from drone footage. The proposed dataset closes the gap between synthetic data and realistic trajectories, advancing the research in trajectory forecasting of road vehicles, offering both accurate multimodal ground-truth annotations and authentic human-driven vehicle trajectories.
Abstract (translated)
数据集对于训练和评估用于交通分析及提高道路安全的计算机视觉模型至关重要。现有的真实数据集能够捕捉到现实世界中的场景,包括真实的道路物体行为,然而它们通常缺乏精确的真实标注信息。相比之下,合成数据集在标记大量帧方面发挥着重要作用,并且无需额外成本或时间消耗。但是,合成数据集的一个普遍缺点是缺少真实的车辆运动,因为轨迹通常是通过人工智能模型或基于规则的系统生成的。 在此研究中,我们引入了R3ST(Realistic 3D Synthetic Trajectories),这是一个合成数据集,它克服了上述限制,通过生成一个合成的三维环境,并将来自SinD的真实世界轨迹整合进去。SinD是一个从无人机拍摄到的鸟瞰图视频记录的数据集。所提出的数据集弥合了合成数据和现实轨迹之间的差距,在道路车辆轨迹预测的研究中取得进展,提供准确的多模态真实标注以及真实的由人类驾驶产生的车辆轨迹。
URL
https://arxiv.org/abs/2512.16784