Abstract
Object shape and pose estimation is a foundational robotics problem, supporting tasks from manipulation to scene understanding and navigation. We present a fast local solver for shape and pose estimation which requires only category-level object priors and admits an efficient certificate of global optimality. Given an RGB-D image of an object, we use a learned front-end to detect sparse, category-level semantic keypoints on the target object. We represent the target object's unknown shape using a linear active shape model and pose a maximum a posteriori optimization problem to solve for position, orientation, and shape simultaneously. Expressed in unit quaternions, this problem admits first-order optimality conditions in the form of an eigenvalue problem with eigenvector nonlinearities. Our primary contribution is to solve this problem efficiently with self-consistent field iteration, which only requires computing a 4-by-4 matrix and finding its minimum eigenvalue-vector pair at each iterate. Solving a linear system for the corresponding Lagrange multipliers gives a simple global optimality certificate. One iteration of our solver runs in about 100 microseconds, enabling fast outlier rejection. We test our method on synthetic data and a variety of real-world settings, including two public datasets and a drone tracking scenario. Code is released at this https URL.
Abstract (translated)
物体形状和姿态估计是机器人技术中的一个基础问题,支持从操作到场景理解和导航等各种任务。我们提出了一种快速局部求解器用于形状和姿态的估计,该求解器只需要类别级别的对象先验,并允许有效的全局最优性证明。给定一个物体的RGB-D图像,我们使用学习得到的前端来检测目标物体质心上的稀疏、类别级别的语义关键点。我们将目标物体未知的形状表示为线性活动形状模型,并提出最大后验概率优化问题以同时求解位置、方向和形状。 用单位四元数表示该问题时,它允许采用形式化为特征值问题(具有非线性特征向量)的一阶最优性条件。我们的主要贡献是利用自洽场迭代高效地解决了这个问题,在每次迭代中只需要计算一个4×4矩阵并找到其最小的特征值-特征向量对。求解相应的拉格朗日乘数对应的线性系统可以给出简单的全局最优证明。 我们求解器的一个迭代大约需要100微秒,这使得快速检测和排除离群点成为可能。我们在合成数据集以及包括两个公共数据集在内的各种现实世界场景下测试了我们的方法,并在无人机追踪场景中进行了验证。代码已开源(链接见原文)。 这段描述介绍了一种新颖的方法来解决机器人视觉中的形状和姿态估计问题,它不仅速度快,而且能够提供全局最优性的证明。
URL
https://arxiv.org/abs/2509.18979