Paper Reading AI Learner

Category-Level Object Shape and Pose Estimation in Less Than a Millisecond

2025-09-23 13:29:32
Lorenzo Shaikewitz, Tim Nguyen, Luca Carlone

Abstract

Object shape and pose estimation is a foundational robotics problem, supporting tasks from manipulation to scene understanding and navigation. We present a fast local solver for shape and pose estimation which requires only category-level object priors and admits an efficient certificate of global optimality. Given an RGB-D image of an object, we use a learned front-end to detect sparse, category-level semantic keypoints on the target object. We represent the target object's unknown shape using a linear active shape model and pose a maximum a posteriori optimization problem to solve for position, orientation, and shape simultaneously. Expressed in unit quaternions, this problem admits first-order optimality conditions in the form of an eigenvalue problem with eigenvector nonlinearities. Our primary contribution is to solve this problem efficiently with self-consistent field iteration, which only requires computing a 4-by-4 matrix and finding its minimum eigenvalue-vector pair at each iterate. Solving a linear system for the corresponding Lagrange multipliers gives a simple global optimality certificate. One iteration of our solver runs in about 100 microseconds, enabling fast outlier rejection. We test our method on synthetic data and a variety of real-world settings, including two public datasets and a drone tracking scenario. Code is released at this https URL.

Abstract (translated)

物体形状和姿态估计是机器人技术中的一个基础问题,支持从操作到场景理解和导航等各种任务。我们提出了一种快速局部求解器用于形状和姿态的估计,该求解器只需要类别级别的对象先验,并允许有效的全局最优性证明。给定一个物体的RGB-D图像,我们使用学习得到的前端来检测目标物体质心上的稀疏、类别级别的语义关键点。我们将目标物体未知的形状表示为线性活动形状模型,并提出最大后验概率优化问题以同时求解位置、方向和形状。 用单位四元数表示该问题时,它允许采用形式化为特征值问题(具有非线性特征向量)的一阶最优性条件。我们的主要贡献是利用自洽场迭代高效地解决了这个问题,在每次迭代中只需要计算一个4×4矩阵并找到其最小的特征值-特征向量对。求解相应的拉格朗日乘数对应的线性系统可以给出简单的全局最优证明。 我们求解器的一个迭代大约需要100微秒,这使得快速检测和排除离群点成为可能。我们在合成数据集以及包括两个公共数据集在内的各种现实世界场景下测试了我们的方法,并在无人机追踪场景中进行了验证。代码已开源(链接见原文)。 这段描述介绍了一种新颖的方法来解决机器人视觉中的形状和姿态估计问题,它不仅速度快,而且能够提供全局最优性的证明。

URL

https://arxiv.org/abs/2509.18979

PDF

https://arxiv.org/pdf/2509.18979.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot