Paper Reading AI Learner

Cross-DINO: Cross the Deep MLP and Transformer for Small Object Detection

2025-05-28 01:33:23
Guiping Cao, Wenjian Huang, Xiangyuan Lan, Jianguo Zhang, Dongmei Jiang, Yaowei Wang

Abstract

Small Object Detection (SOD) poses significant challenges due to limited information and the model's low class prediction score. While Transformer-based detectors have shown promising performance, their potential for SOD remains largely unexplored. In typical DETR-like frameworks, the CNN backbone network, specialized in aggregating local information, struggles to capture the necessary contextual information for SOD. The multiple attention layers in the Transformer Encoder face difficulties in effectively attending to small objects and can also lead to blurring of features. Furthermore, the model's lower class prediction score of small objects compared to large objects further increases the difficulty of SOD. To address these challenges, we introduce a novel approach called Cross-DINO. This approach incorporates the deep MLP network to aggregate initial feature representations with both short and long range information for SOD. Then, a new Cross Coding Twice Module (CCTM) is applied to integrate these initial representations to the Transformer Encoder feature, enhancing the details of small objects. Additionally, we introduce a new kind of soft label named Category-Size (CS), integrating the Category and Size of objects. By treating CS as new ground truth, we propose a new loss function called Boost Loss to improve the class prediction score of the model. Extensive experimental results on COCO, WiderPerson, VisDrone, AI-TOD, and SODA-D datasets demonstrate that Cross-DINO efficiently improves the performance of DETR-like models on SOD. Specifically, our model achieves 36.4% APs on COCO for SOD with only 45M parameters, outperforming the DINO by +4.4% APS (36.4% vs. 32.0%) with fewer parameters and FLOPs, under 12 epochs training setting. The source codes will be available at this https URL.

Abstract (translated)

小目标检测(SOD)面临诸多挑战,主要是由于信息有限和模型的类别预测得分较低。尽管基于Transformer的探测器已显示出良好的性能,但它们在小目标检测方面的潜力尚未得到充分探索。在典型的DETR框架中,CNN骨干网络专门用于汇聚局部信息,在捕捉必要的上下文信息以进行小目标检测时显得力不从心。Transformer编码器中的多层注意力机制难以有效关注到小物体,并且还可能导致特征模糊。此外,模型对小对象的类别预测得分低于大对象进一步增加了SOD的难度。 为解决这些挑战,我们提出了一种新的方法叫作Cross-DINO(跨DINO)。这种方法通过使用深度MLP网络来汇聚初始特征表示与短程和长程信息,以应对SOD。随后应用一个新的交叉编码两次模块(CCTM),将这些初始表示集成到Transformer编码器的特性中,从而增强对小目标细节的捕捉能力。 此外,我们还引入了一种新的软标签称为类别-大小(CS),这种标签整合了对象的类别和大小信息。通过将CS作为新的真实值对待,我们提出了一种新的损失函数——Boost Loss,以提高模型的类别预测得分。 在COCO、WiderPerson、VisDrone、AI-TOD和SODA-D等数据集上的大量实验结果表明,Cross-DINO能够有效地提升DETR类似模型在小目标检测中的性能。具体而言,在仅有45M参数的情况下,我们的模型在COCO上实现了36.4%的APs(平均精度)用于SOD,比DINO高出+4.4% APS(36.4% vs 32.0%),且参数和FLOPs更少。这在仅训练12个epoch的情况下得以实现。 源代码将在[此处](https://this-url.com)提供。

URL

https://arxiv.org/abs/2505.21868

PDF

https://arxiv.org/pdf/2505.21868.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot