Abstract
3D object localisation based on a sequence of camera measurements is essential for safety-critical surveillance tasks, such as drone-based wildfire monitoring. Localisation of objects detected with a camera can typically be solved with dense depth estimation or 3D scene reconstruction. However, in the context of distant objects or tasks limited by the amount of available computational resources, neither solution is feasible. In this paper, we show that the task can be solved using particle filters for both single and multiple target scenarios. The method was studied using a 3D simulation and a drone-based image segmentation sequence with global navigation satellite system (GNSS)-based camera pose estimates. The results showed that a particle filter can be used to solve practical localisation tasks based on camera poses and image segments in these situations where other solutions fail. The particle filter is independent of the detection method, making it flexible for new tasks. The study also demonstrates that drone-based wildfire monitoring can be conducted using the proposed method paired with a pre-existing image segmentation model.
Abstract (translated)
基于相机测量序列的3D物体定位对于安全关键性的监控任务(如无人机森林火灾监测)至关重要。通常,可以通过密集深度估计或三维场景重建来解决通过摄像头检测到的对象的定位问题。然而,在远距离对象或受可用计算资源限制的情况下,这两种方法都不适用。在本文中,我们展示了如何使用粒子滤波器来解决单个和多个目标场景下的任务。该方法是在3D模拟环境中以及结合基于全球导航卫星系统(GNSS)的摄像机姿态估计的无人机图像分割序列上进行研究的。结果表明,在其他解决方案失效的情况下,可以使用粒子过滤器根据摄像机姿势和图像片段执行实际定位任务。此外,粒子滤波器与检测方法无关,使其能够灵活应用于新任务。该研究表明,通过结合现有的图像分割模型,可以利用所提出的方法来进行无人机森林火灾监测。
URL
https://arxiv.org/abs/2509.20906