Abstract
This paper proposes DroFiT (Drone Frequency lightweight Transformer for speech enhancement, a single microphone speech enhancement network for severe drone self-noise. DroFit integrates a frequency-wise Transformer with a full/sub-band hybrid encoder-decoder and a TCN back-end for memory-efficient streaming. A learnable skip-and-gate fusion with a combined spectral-temporal loss further refines reconstruction. The model is trained on VoiceBank-DEMAND mixed with recorded drone noise (-5 to -25 dB SNR) and evaluate using standard speech enhancement metrics and computational efficiency. Experimental results show that DroFiT achieves competitive enhancement performance while significantly reducing computational and memory demands, paving the way for real-time processing on resource-constrained UAV platforms. Audio demo samples are available on our demo page.
Abstract (translated)
本文提出了DroFiT(Drone Frequency lightweight Transformer,用于语音增强的单麦克风严重无人机自身噪声处理网络)。DroFit 集成了频率感知的Transformer、全频段/子带混合编解码器以及TCN后端,以实现内存高效的流式处理。通过学习型跳过与门控融合技术结合频谱-时序损失进一步优化重建效果。该模型在VoiceBank-DEMAND数据集上进行训练(混入录制的无人机噪声,信噪比为-5至-25dB),并使用标准语音增强指标和计算效率进行评估。实验结果表明,DroFiT 在实现竞争性的语音增强性能的同时显著降低了计算需求和内存占用,为资源受限的无人机平台上的实时处理铺平了道路。音频演示样本可在我们的展示页面上获取。
URL
https://arxiv.org/abs/2509.16945