Abstract
Small Object Detection (SOD) poses significant challenges due to limited information and the model's low class prediction score. While Transformer-based detectors have shown promising performance, their potential for SOD remains largely unexplored. In typical DETR-like frameworks, the CNN backbone network, specialized in aggregating local information, struggles to capture the necessary contextual information for SOD. The multiple attention layers in the Transformer Encoder face difficulties in effectively attending to small objects and can also lead to blurring of features. Furthermore, the model's lower class prediction score of small objects compared to large objects further increases the difficulty of SOD. To address these challenges, we introduce a novel approach called Cross-DINO. This approach incorporates the deep MLP network to aggregate initial feature representations with both short and long range information for SOD. Then, a new Cross Coding Twice Module (CCTM) is applied to integrate these initial representations to the Transformer Encoder feature, enhancing the details of small objects. Additionally, we introduce a new kind of soft label named Category-Size (CS), integrating the Category and Size of objects. By treating CS as new ground truth, we propose a new loss function called Boost Loss to improve the class prediction score of the model. Extensive experimental results on COCO, WiderPerson, VisDrone, AI-TOD, and SODA-D datasets demonstrate that Cross-DINO efficiently improves the performance of DETR-like models on SOD. Specifically, our model achieves 36.4% APs on COCO for SOD with only 45M parameters, outperforming the DINO by +4.4% APS (36.4% vs. 32.0%) with fewer parameters and FLOPs, under 12 epochs training setting. The source codes will be available at this https URL.
Abstract (translated)
小目标检测(SOD)面临诸多挑战,主要是由于信息有限和模型的类别预测得分较低。尽管基于Transformer的探测器已显示出良好的性能,但它们在小目标检测方面的潜力尚未得到充分探索。在典型的DETR框架中,CNN骨干网络专门用于汇聚局部信息,在捕捉必要的上下文信息以进行小目标检测时显得力不从心。Transformer编码器中的多层注意力机制难以有效关注到小物体,并且还可能导致特征模糊。此外,模型对小对象的类别预测得分低于大对象进一步增加了SOD的难度。 为解决这些挑战,我们提出了一种新的方法叫作Cross-DINO(跨DINO)。这种方法通过使用深度MLP网络来汇聚初始特征表示与短程和长程信息,以应对SOD。随后应用一个新的交叉编码两次模块(CCTM),将这些初始表示集成到Transformer编码器的特性中,从而增强对小目标细节的捕捉能力。 此外,我们还引入了一种新的软标签称为类别-大小(CS),这种标签整合了对象的类别和大小信息。通过将CS作为新的真实值对待,我们提出了一种新的损失函数——Boost Loss,以提高模型的类别预测得分。 在COCO、WiderPerson、VisDrone、AI-TOD和SODA-D等数据集上的大量实验结果表明,Cross-DINO能够有效地提升DETR类似模型在小目标检测中的性能。具体而言,在仅有45M参数的情况下,我们的模型在COCO上实现了36.4%的APs(平均精度)用于SOD,比DINO高出+4.4% APS(36.4% vs 32.0%),且参数和FLOPs更少。这在仅训练12个epoch的情况下得以实现。 源代码将在[此处](https://this-url.com)提供。
URL
https://arxiv.org/abs/2505.21868