Abstract
Detecting tiny objects in multimodal Red-Green-Blue-Thermal (RGBT) imagery is a critical challenge in computer vision, particularly in surveillance, search and rescue, and autonomous navigation. Drone-based scenarios exacerbate these challenges due to spatial misalignment, low-light conditions, occlusion, and cluttered backgrounds. Current methods struggle to leverage the complementary information between visible and thermal modalities effectively. We propose COXNet, a novel framework for RGBT tiny object detection, addressing these issues through three core innovations: i) the Cross-Layer Fusion Module, fusing high-level visible and low-level thermal features for enhanced semantic and spatial accuracy; ii) the Dynamic Alignment and Scale Refinement module, correcting cross-modal spatial misalignments and preserving multi-scale features; and iii) an optimized label assignment strategy using the GeoShape Similarity Measure for better localization. COXNet achieves a 3.32\% mAP$_{50}$ improvement on the RGBTDronePerson dataset over state-of-the-art methods, demonstrating its effectiveness for robust detection in complex environments.
Abstract (translated)
在多模态红绿蓝热(RGBT)图像中检测微小物体是计算机视觉中的一个关键挑战,尤其是在监控、搜索和救援以及自主导航等领域。基于无人机的场景由于空间错位、低光照条件、遮挡和杂乱背景等因素而加剧了这些问题。当前的方法难以有效利用可见光与热成像模态之间的互补信息。我们提出了一种名为COXNet的新框架,用于RGBT微小物体检测,通过三大核心创新解决了上述问题:i) 跨层融合模块,将高级别的可见光特征和低级别的热成像特征进行融合,以提高语义和空间精度;ii) 动态对齐与尺度细化模块,纠正跨模态的空间错位,并保持多尺度特征;iii) 使用GeoShape相似度测量的优化标签分配策略,用于更好的定位。COXNet在RGBTDronePerson数据集上比最先进的方法提高了3.32%的mAP$_{50}$,证明了其在复杂环境中进行稳健检测的有效性。
URL
https://arxiv.org/abs/2508.09533