Paper Reading AI Learner

Accelerated Feature Detectors for Visual SLAM: A Comparative Study of FPGA vs GPU

2025-10-15 13:40:55
Ruiqi Ye, Mikel Luj\'an

Abstract

Feature detection is a common yet time-consuming module in Simultaneous Localization and Mapping (SLAM) implementations, which are increasingly deployed on power-constrained platforms, such as drones. Graphics Processing Units (GPUs) have been a popular accelerator for computer vision in general, and feature detection and SLAM in particular. On the other hand, System-on-Chips (SoCs) with integrated Field Programmable Gate Array (FPGA) are also widely available. This paper presents the first study of hardware-accelerated feature detectors considering a Visual SLAM (V-SLAM) pipeline. We offer new insights by comparing the best GPU-accelerated FAST, Harris, and SuperPoint implementations against the FPGA-accelerated counterparts on modern SoCs (Nvidia Jetson Orin and AMD Versal). The evaluation shows that when using a non-learning-based feature detector such as FAST and Harris, their GPU implementations, and the GPU-accelerated V-SLAM can achieve better run-time performance and energy efficiency than the FAST and Harris FPGA implementations as well as the FPGA-accelerated V-SLAM. However, when considering a learning-based detector such as SuperPoint, its FPGA implementation can achieve better run-time performance and energy efficiency (up to 3.1$\times$ and 1.4$\times$ improvements, respectively) than the GPU implementation. The FPGA-accelerated V-SLAM can also achieve comparable run-time performance compared to the GPU-accelerated V-SLAM, with better FPS in 2 out of 5 dataset sequences. When considering the accuracy, the results show that the GPU-accelerated V-SLAM is more accurate than the FPGA-accelerated V-SLAM in general. Last but not least, the use of hardware acceleration for feature detection could further improve the performance of the V-SLAM pipeline by having the global bundle adjustment module invoked less frequently without sacrificing accuracy.

Abstract (translated)

特征检测是同步定位与建图(SLAM)实现中的一个常见但耗时的模块,而这些实现越来越多地部署在如无人机等能耗受限平台上。图形处理单元(GPU)一直是计算机视觉加速器的热门选择,尤其是对于特征检测和SLAM而言。另一方面,集成了现场可编程门阵列(FPGA)的片上系统(SoC)也广泛可用。本文首次研究了硬件加速特征检测器在视觉SLAM管道中的应用,并通过比较现代SoCs(如Nvidia Jetson Orin和AMD Versal)上的GPU加速FAST、Harris以及SuperPoint实现与对应的FPGA实现,提供了新的见解。 评估结果表明,在使用基于非学习的特征检测器(例如FAST和Harris)时,它们的GPU实现及GPU加速视觉SLAM能够比FAST和Harris的FPGA实现以及FPGA加速视觉SLAM获得更好的运行时间和能效。然而,当考虑SuperPoint这种基于学习的检测器时,其FPGA实现可以在运行时间性能和能效方面(分别高达3.1倍和1.4倍改进)优于GPU实现。在2个数据集中,FPGA加速视觉SLAM也能与GPU加速视觉SLAM达到相当的运行时间性能,并且在5个序列中的2个中FPS更优。 就准确性而言,结果表明,在一般情况下,GPU加速视觉SLAM比FPGA加速视觉SLAM更为准确。最后但同样重要的是,硬件加速特征检测器的应用可以通过较少地调用全局束调整模块进一步提升视觉SLAM管道的性能,同时不会牺牲精度。

URL

https://arxiv.org/abs/2510.13546

PDF

https://arxiv.org/pdf/2510.13546.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot