Abstract
This article examines state estimation in discrete-time nonlinear stochastic systems with finite-dimensional states and infinite-dimensional measurements, motivated by real-world applications such as vision-based localization and tracking. We develop an extended Kalman filter (EKF) for real-time state estimation, with the measurement noise modeled as an infinite-dimensional random field. When applied to vision-based state estimation, the measurement Jacobians required to implement the EKF are shown to correspond to image gradients. This result provides a novel system-theoretic justification for the use of image gradients as features for vision-based state estimation, contrasting with their (often heuristic) introduction in many computer-vision pipelines. We demonstrate the practical utility of the EKF on a public real-world dataset involving the localization of an aerial drone using video from a downward-facing monocular camera. The EKF is shown to outperform VINS-MONO, an established visual-inertial odometry algorithm, in some cases achieving mean squared error reductions of up to an order of magnitude.
Abstract (translated)
本文探讨了离散时间非线性随机系统中的状态估计问题,这类系统的状态是有限维度的,而测量则是无限维度的。这种研究受到现实世界应用(如基于视觉的定位和跟踪)的启发。我们开发了一种扩展卡尔曼滤波器(EKF),用于实时状态估计,并将测量噪声建模为一个无限维度的随机场。当应用于基于视觉的状态估计时,实施EKF所需的测量雅可比矩阵被证明对应于图像梯度。这一结果提供了一个新颖的系统理论依据,解释了为什么在许多计算机视觉管道中,通常以启发式方式引入的图像梯度可以用作基于视觉状态估计中的特征。 我们通过一个公开的真实世界数据集展示了扩展卡尔曼滤波器的实际效用——该数据集涉及使用向下视图单目摄像头进行空中无人机定位。结果显示,在某些情况下,EKF的表现优于VINS-MONO(一种已经确立的视觉惯性里程计算法),在均方误差方面最多可减少一个数量级。
URL
https://arxiv.org/abs/2509.18749