Abstract
Oriented object detection for multi-spectral imagery faces significant challenges due to differences both within and between modalities. Although existing methods have improved detection accuracy through complex network architectures, their high computational complexity and memory consumption severely restrict their performance. Motivated by the success of large kernel convolutions in remote sensing, we propose MO R-CNN, a lightweight framework for multi-spectral oriented detection featuring heterogeneous feature extraction network (HFEN), single modality supervision (SMS), and condition-based multimodal label fusion (CMLF). HFEN leverages inter-modal differences to adaptively align, merge, and enhance multi-modal features. SMS constrains multi-scale features and enables the model to learn from multiple modalities. CMLF fuses multimodal labels based on specific rules, providing the model with a more robust and consistent supervisory signal. Experiments on the DroneVehicle, VEDAI and OGSOD datasets prove the superiority of our method. The source code is available at:this https URL.
Abstract (translated)
面向对象的多光谱图像检测面临由于模态内部和模态之间差异带来的重大挑战。尽管现有的方法通过复杂的网络架构提高了检测精度,但其计算复杂度高、内存消耗大,严重限制了性能的发挥。鉴于在遥感领域大型卷积核的成功应用,我们提出了MO R-CNN,一个轻量级框架用于多光谱定向检测,该框架包括异构特征提取网络(HFEN)、单模态监督(SMS)和基于条件的多模态标签融合(CMLF)。HFEN利用跨模态差异来自适应地对齐、合并并增强多模态特征。SMS限制了多尺度特征,并使模型能够从多种模态中学习。CMLF根据特定规则融合多模态标签,为模型提供了更稳健和一致的监督信号。在DroneVehicle、VEDAI 和 OGSOD 数据集上的实验证明了我们方法的优势。源代码可在以下网址获取:[这个链接](this https URL)。
URL
https://arxiv.org/abs/2509.16957