Abstract
Accurate rotational odometry is crucial for autonomous robotic systems, particularly for small, power-constrained platforms such as drones and mobile robots. This study introduces thermal-gyro fusion, a novel sensor fusion approach that integrates ultra-low-resolution thermal imaging with gyroscope readings for rotational odometry. Unlike RGB cameras, thermal imaging is invariant to lighting conditions and, when fused with gyroscopic data, mitigates drift which is a common limitation of inertial sensors. We first develop a multimodal data acquisition system to collect synchronized thermal and gyroscope data, along with rotational speed labels, across diverse environments. Subsequently, we design and train a lightweight Convolutional Neural Network (CNN) that fuses both modalities for rotational speed estimation. Our analysis demonstrates that thermal-gyro fusion enables a significant reduction in thermal camera resolution without significantly compromising accuracy, thereby improving computational efficiency and memory utilization. These advantages make our approach well-suited for real-time deployment in resource-constrained robotic systems. Finally, to facilitate further research, we publicly release our dataset as supplementary material.
Abstract (translated)
精确的旋转里程计对于自主机器人系统至关重要,尤其是在小型、受功率限制的平台(如无人机和移动机器人)上。本研究介绍了热像仪-陀螺仪融合(thermal-gyro fusion),这是一种新颖的传感器融合方法,它将超低分辨率热成像与陀螺仪读数相结合用于旋转里程计。不同于RGB相机,热成像不受照明条件的影响,并且当与陀螺数据结合使用时,可以缓解惯性传感器常见的漂移问题。 我们首先开发了一个多模态数据采集系统,用于收集同步的热像和陀螺仪数据以及不同环境中的旋转速度标签。随后,设计并训练了一种轻量级卷积神经网络(CNN),该网络融合这两种模式以进行旋转速度估计。我们的分析表明,通过热像-陀螺仪融合可以在不显著影响精度的情况下大幅降低热成像相机的分辨率,从而提高计算效率和内存利用率。这些优点使我们的方法非常适合在资源受限的机器人系统中实时部署。 最后,为了促进进一步的研究,我们将数据集作为补充材料公开发布。
URL
https://arxiv.org/abs/2506.12536