Paper Reading AI Learner

Finding 3D Positions of Distant Objects from Noisy Camera Movement and Semantic Segmentation Sequences

2025-09-25 08:46:37
Julius Pesonen, Arno Solin, Eija Honkavaara

Abstract

3D object localisation based on a sequence of camera measurements is essential for safety-critical surveillance tasks, such as drone-based wildfire monitoring. Localisation of objects detected with a camera can typically be solved with dense depth estimation or 3D scene reconstruction. However, in the context of distant objects or tasks limited by the amount of available computational resources, neither solution is feasible. In this paper, we show that the task can be solved using particle filters for both single and multiple target scenarios. The method was studied using a 3D simulation and a drone-based image segmentation sequence with global navigation satellite system (GNSS)-based camera pose estimates. The results showed that a particle filter can be used to solve practical localisation tasks based on camera poses and image segments in these situations where other solutions fail. The particle filter is independent of the detection method, making it flexible for new tasks. The study also demonstrates that drone-based wildfire monitoring can be conducted using the proposed method paired with a pre-existing image segmentation model.

Abstract (translated)

基于相机测量序列的3D物体定位对于安全关键性的监控任务(如无人机森林火灾监测)至关重要。通常,可以通过密集深度估计或三维场景重建来解决通过摄像头检测到的对象的定位问题。然而,在远距离对象或受可用计算资源限制的情况下,这两种方法都不适用。在本文中,我们展示了如何使用粒子滤波器来解决单个和多个目标场景下的任务。该方法是在3D模拟环境中以及结合基于全球导航卫星系统(GNSS)的摄像机姿态估计的无人机图像分割序列上进行研究的。结果表明,在其他解决方案失效的情况下,可以使用粒子过滤器根据摄像机姿势和图像片段执行实际定位任务。此外,粒子滤波器与检测方法无关,使其能够灵活应用于新任务。该研究表明,通过结合现有的图像分割模型,可以利用所提出的方法来进行无人机森林火灾监测。

URL

https://arxiv.org/abs/2509.20906

PDF

https://arxiv.org/pdf/2509.20906.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot