Paper Reading AI Learner

LoD-Loc v2: Aerial Visual Localization over Low Level-of-Detail City Models using Explicit Silhouette Alignment

2025-07-01 10:56:51
Juelin Zhu, Shuaibang Peng, Long Wang, Hanlin Tan, Yu Liu, Maojun Zhang, Shen Yan

Abstract

We propose a novel method for aerial visual localization over low Level-of-Detail (LoD) city models. Previous wireframe-alignment-based method LoD-Loc has shown promising localization results leveraging LoD models. However, LoD-Loc mainly relies on high-LoD (LoD3 or LoD2) city models, but the majority of available models and those many countries plan to construct nationwide are low-LoD (LoD1). Consequently, enabling localization on low-LoD city models could unlock drones' potential for global urban localization. To address these issues, we introduce LoD-Loc v2, which employs a coarse-to-fine strategy using explicit silhouette alignment to achieve accurate localization over low-LoD city models in the air. Specifically, given a query image, LoD-Loc v2 first applies a building segmentation network to shape building silhouettes. Then, in the coarse pose selection stage, we construct a pose cost volume by uniformly sampling pose hypotheses around a prior pose to represent the pose probability distribution. Each cost of the volume measures the degree of alignment between the projected and predicted silhouettes. We select the pose with maximum value as the coarse pose. In the fine pose estimation stage, a particle filtering method incorporating a multi-beam tracking approach is used to efficiently explore the hypothesis space and obtain the final pose estimation. To further facilitate research in this field, we release two datasets with LoD1 city models covering 10.7 km , along with real RGB queries and ground-truth pose annotations. Experimental results show that LoD-Loc v2 improves estimation accuracy with high-LoD models and enables localization with low-LoD models for the first time. Moreover, it outperforms state-of-the-art baselines by large margins, even surpassing texture-model-based methods, and broadens the convergence basin to accommodate larger prior errors.

Abstract (translated)

我们提出了一种针对低细节层次(Level of Detail,简称 LoD)城市模型的空中视觉定位的新方法。先前基于线框对齐的方法LoD-Loc已经展示了利用LoD模型进行定位的有希望的结果。然而,LoD-Loc主要依赖于高LoD(如LoD3或LoD2)的城市模型,而大多数现有可用模型以及许多国家计划在全国范围内构建的模型则是低LoD(LoD1)。因此,能够在低LoD城市模型上实现定位可以使无人机在全球范围内的城市定位中发挥更大的潜力。为了解决这些问题,我们推出了LoD-Loc v2,该方法采用了一种从粗到细的策略,并通过显式的轮廓对齐来实现在空中对低LoD城市模型的精确定位。 具体而言,在给定查询图像时,LoD-Loc v2首先使用建筑物分割网络生成建筑轮廓。然后在粗略姿态选择阶段,我们通过对先验姿态周围均匀采样姿态假设构建姿态成本体积以表示姿态概率分布。这个体积中的每个代价衡量投影和预测轮廓之间的对齐程度。我们将具有最大值的姿态选作粗略姿态。在精细姿态估计阶段,采用了一种融合多束跟踪方法的粒子滤波技术来高效地探索假设空间并获得最终的姿态估计。 为了进一步促进该领域的研究,我们发布了两个包含低LoD(LoD1)城市模型的数据集,这些数据集覆盖了总计10.7公里的区域,并附带真实的RGB查询图像和姿态真值标注。实验结果显示,与现有的最先进的基准方法相比,LoD-Loc v2不仅在高细节层次的城市模型上提高了估计精度,在低LoD模型上的定位能力也首次得以实现。此外,它大幅超越了基于纹理模型的方法,扩大了收敛范围以适应更大的先验误差。

URL

https://arxiv.org/abs/2507.00659

PDF

https://arxiv.org/pdf/2507.00659.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot