Paper Reading AI Learner

DFIR-DETR: Frequency Domain Enhancement and Dynamic Feature Aggregation for Cross-Scene Small Object Detection

2025-12-08 01:25:10
Bo Gao, Jingcheng Tong, Xingsheng Chen, Han Yu, Zichen Li

Abstract

Detecting small objects in UAV remote sensing images and identifying surface defects in industrial inspection remain difficult tasks. These applications face common obstacles: features are sparse and weak, backgrounds are cluttered, and object scales vary dramatically. Current transformer-based detectors, while powerful, struggle with three critical issues. First, features degrade severely as networks downsample progressively. Second, spatial convolutions cannot capture long-range dependencies effectively. Third, standard upsampling methods inflate feature maps unnecessarily. We introduce DFIR-DETR to tackle these problems through dynamic feature aggregation combined with frequency-domain processing. Our architecture builds on three novel components. The DCFA module uses dynamic K-sparse attention, cutting complexity from O(N2) down to O(NK), and employs spatial gated linear units for better nonlinear modeling. The DFPN module applies amplitude-normalized upsampling to prevent feature inflation and uses dual-path shuffle convolution to retain spatial details across scales. The FIRC3 module operates in the frequency domain, achieving global receptive fields without sacrificing efficiency. We tested our method extensively on NEU-DET and VisDrone datasets. Results show mAP50 scores of 92.9% and 51.6% respectively-both state-of-the-art. The model stays lightweight with just 11.7M parameters and 41.2 GFLOPs. Strong performance across two very different domains confirms that DFIR-DETR generalizes well and works effectively in resource-limited settings for cross-scene small object detection.

Abstract (translated)

在无人机遥感图像中检测小型物体以及在工业检查中识别表面缺陷仍然是具有挑战性的任务。这些应用面临一些共同的障碍:特征稀疏且微弱、背景复杂,以及目标尺度变化巨大。尽管基于变压器的探测器已经非常强大,但它们仍然面临着三个关键问题。首先,随着网络逐步下采样,特征会严重退化。其次,空间卷积无法有效捕捉长距离依赖关系。第三,标准上采样方法会导致特征图不必要的膨胀。为此,我们提出了DFIR-DETR(动态特征聚合与频域处理结合的方法),旨在通过引入三个新颖的组件来解决这些问题。 1. **DCFA模块**:该模块采用动态K稀疏注意力机制,将复杂度从O(N^2)降低到O(NK),并利用空间门控线性单元进行更好的非线性建模。 2. **DFPN模块**:此模块应用幅度归一化上采样以防止特征膨胀,并使用双路径混洗卷积来跨尺度保留空间细节。 3. **FIRC3模块**:该模块在频域中操作,实现了全局感受野而不牺牲效率。 我们在NEU-DET和VisDrone数据集上对方法进行了广泛的测试。实验结果表明,在这两个数据集中分别取得了92.9%和51.6%的mAP50分数——两者均为行业领先水平。模型保持轻量级,仅包含11.7M参数和41.2 GFLOPs。在两个非常不同的领域中表现出色,证明了DFIR-DETR具有良好的泛化能力,并且适用于资源受限环境中的跨场景小型物体检测任务。

URL

https://arxiv.org/abs/2512.07078

PDF

https://arxiv.org/pdf/2512.07078.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot