Abstract
Detecting small objects in UAV remote sensing images and identifying surface defects in industrial inspection remain difficult tasks. These applications face common obstacles: features are sparse and weak, backgrounds are cluttered, and object scales vary dramatically. Current transformer-based detectors, while powerful, struggle with three critical issues. First, features degrade severely as networks downsample progressively. Second, spatial convolutions cannot capture long-range dependencies effectively. Third, standard upsampling methods inflate feature maps unnecessarily. We introduce DFIR-DETR to tackle these problems through dynamic feature aggregation combined with frequency-domain processing. Our architecture builds on three novel components. The DCFA module uses dynamic K-sparse attention, cutting complexity from O(N2) down to O(NK), and employs spatial gated linear units for better nonlinear modeling. The DFPN module applies amplitude-normalized upsampling to prevent feature inflation and uses dual-path shuffle convolution to retain spatial details across scales. The FIRC3 module operates in the frequency domain, achieving global receptive fields without sacrificing efficiency. We tested our method extensively on NEU-DET and VisDrone datasets. Results show mAP50 scores of 92.9% and 51.6% respectively-both state-of-the-art. The model stays lightweight with just 11.7M parameters and 41.2 GFLOPs. Strong performance across two very different domains confirms that DFIR-DETR generalizes well and works effectively in resource-limited settings for cross-scene small object detection.
Abstract (translated)
在无人机遥感图像中检测小型物体以及在工业检查中识别表面缺陷仍然是具有挑战性的任务。这些应用面临一些共同的障碍:特征稀疏且微弱、背景复杂,以及目标尺度变化巨大。尽管基于变压器的探测器已经非常强大,但它们仍然面临着三个关键问题。首先,随着网络逐步下采样,特征会严重退化。其次,空间卷积无法有效捕捉长距离依赖关系。第三,标准上采样方法会导致特征图不必要的膨胀。为此,我们提出了DFIR-DETR(动态特征聚合与频域处理结合的方法),旨在通过引入三个新颖的组件来解决这些问题。 1. **DCFA模块**:该模块采用动态K稀疏注意力机制,将复杂度从O(N^2)降低到O(NK),并利用空间门控线性单元进行更好的非线性建模。 2. **DFPN模块**:此模块应用幅度归一化上采样以防止特征膨胀,并使用双路径混洗卷积来跨尺度保留空间细节。 3. **FIRC3模块**:该模块在频域中操作,实现了全局感受野而不牺牲效率。 我们在NEU-DET和VisDrone数据集上对方法进行了广泛的测试。实验结果表明,在这两个数据集中分别取得了92.9%和51.6%的mAP50分数——两者均为行业领先水平。模型保持轻量级,仅包含11.7M参数和41.2 GFLOPs。在两个非常不同的领域中表现出色,证明了DFIR-DETR具有良好的泛化能力,并且适用于资源受限环境中的跨场景小型物体检测任务。
URL
https://arxiv.org/abs/2512.07078