Abstract
Feature detection is a common yet time-consuming module in Simultaneous Localization and Mapping (SLAM) implementations, which are increasingly deployed on power-constrained platforms, such as drones. Graphics Processing Units (GPUs) have been a popular accelerator for computer vision in general, and feature detection and SLAM in particular. On the other hand, System-on-Chips (SoCs) with integrated Field Programmable Gate Array (FPGA) are also widely available. This paper presents the first study of hardware-accelerated feature detectors considering a Visual SLAM (V-SLAM) pipeline. We offer new insights by comparing the best GPU-accelerated FAST, Harris, and SuperPoint implementations against the FPGA-accelerated counterparts on modern SoCs (Nvidia Jetson Orin and AMD Versal). The evaluation shows that when using a non-learning-based feature detector such as FAST and Harris, their GPU implementations, and the GPU-accelerated V-SLAM can achieve better run-time performance and energy efficiency than the FAST and Harris FPGA implementations as well as the FPGA-accelerated V-SLAM. However, when considering a learning-based detector such as SuperPoint, its FPGA implementation can achieve better run-time performance and energy efficiency (up to 3.1$\times$ and 1.4$\times$ improvements, respectively) than the GPU implementation. The FPGA-accelerated V-SLAM can also achieve comparable run-time performance compared to the GPU-accelerated V-SLAM, with better FPS in 2 out of 5 dataset sequences. When considering the accuracy, the results show that the GPU-accelerated V-SLAM is more accurate than the FPGA-accelerated V-SLAM in general. Last but not least, the use of hardware acceleration for feature detection could further improve the performance of the V-SLAM pipeline by having the global bundle adjustment module invoked less frequently without sacrificing accuracy.
Abstract (translated)
特征检测是同步定位与建图(SLAM)实现中的一个常见但耗时的模块,而这些实现越来越多地部署在如无人机等能耗受限平台上。图形处理单元(GPU)一直是计算机视觉加速器的热门选择,尤其是对于特征检测和SLAM而言。另一方面,集成了现场可编程门阵列(FPGA)的片上系统(SoC)也广泛可用。本文首次研究了硬件加速特征检测器在视觉SLAM管道中的应用,并通过比较现代SoCs(如Nvidia Jetson Orin和AMD Versal)上的GPU加速FAST、Harris以及SuperPoint实现与对应的FPGA实现,提供了新的见解。 评估结果表明,在使用基于非学习的特征检测器(例如FAST和Harris)时,它们的GPU实现及GPU加速视觉SLAM能够比FAST和Harris的FPGA实现以及FPGA加速视觉SLAM获得更好的运行时间和能效。然而,当考虑SuperPoint这种基于学习的检测器时,其FPGA实现可以在运行时间性能和能效方面(分别高达3.1倍和1.4倍改进)优于GPU实现。在2个数据集中,FPGA加速视觉SLAM也能与GPU加速视觉SLAM达到相当的运行时间性能,并且在5个序列中的2个中FPS更优。 就准确性而言,结果表明,在一般情况下,GPU加速视觉SLAM比FPGA加速视觉SLAM更为准确。最后但同样重要的是,硬件加速特征检测器的应用可以通过较少地调用全局束调整模块进一步提升视觉SLAM管道的性能,同时不会牺牲精度。
URL
https://arxiv.org/abs/2510.13546