Abstract
We present a winning solution to RoboSense 2025 Track 4: Cross-Modal Drone Navigation. The task retrieves the most relevant geo-referenced image from a large multi-platform corpus (satellite/drone/ground) given a natural-language query. Two obstacles are severe inter-platform heterogeneity and a domain gap between generic training descriptions and platform-specific test queries. We mitigate these with a domain-aligned preprocessing pipeline and a Mixture-of-Experts (MoE) framework: (i) platform-wise partitioning, satellite augmentation, and removal of orientation words; (ii) an LLM-based caption refinement pipeline to align textual semantics with the distinct visual characteristics of each platform. Using BGE-M3 (text) and EVA-CLIP (image), we train three platform experts using a progressive two-stage, hard-negative mining strategy to enhance discriminative power, and fuse their scores at inference. The system tops the official leaderboard, demonstrating robust cross-modal geo-localization under heterogeneous viewpoints.
Abstract (translated)
我们提出了一种针对RoboSense 2025 Track 4:跨模态无人机导航的获胜解决方案。该任务要求从一个大型多平台语料库(卫星/无人机/地面)中检索与自然语言查询最相关的地理参考图像。两个主要障碍是严重的信息源异质性和一般训练描述和特定平台测试查询之间的领域差距。我们通过使用域对齐的数据预处理管道和混合专家(MoE)框架来缓解这些问题:(i) 平台级别的划分、卫星增强以及去除方向词;(ii) 使用基于大语言模型的标题精炼流程,使文本语义与每个平台独特的视觉特征保持一致。我们利用BGE-M3(文本)和EVA-CLIP(图像),通过逐步两阶段训练策略及难例挖掘方法来增强专家系统的判别能力,并在推理时融合这些评分。该系统在官方排行榜上领先,展示了其在异构视点下强大的跨模态地理定位能力。
URL
https://arxiv.org/abs/2510.20291