Paper Reading AI Learner

DroFiT: A Lightweight Band-fused Frequency Attention Toward Real-time UAV Speech Enhancement

2025-09-21 06:56:32
Jeongmin Lee, Chanhong Jeon, Hyungjoo Seo, Taewook Kang

Abstract

This paper proposes DroFiT (Drone Frequency lightweight Transformer for speech enhancement, a single microphone speech enhancement network for severe drone self-noise. DroFit integrates a frequency-wise Transformer with a full/sub-band hybrid encoder-decoder and a TCN back-end for memory-efficient streaming. A learnable skip-and-gate fusion with a combined spectral-temporal loss further refines reconstruction. The model is trained on VoiceBank-DEMAND mixed with recorded drone noise (-5 to -25 dB SNR) and evaluate using standard speech enhancement metrics and computational efficiency. Experimental results show that DroFiT achieves competitive enhancement performance while significantly reducing computational and memory demands, paving the way for real-time processing on resource-constrained UAV platforms. Audio demo samples are available on our demo page.

Abstract (translated)

本文提出了DroFiT(Drone Frequency lightweight Transformer,用于语音增强的单麦克风严重无人机自身噪声处理网络)。DroFit 集成了频率感知的Transformer、全频段/子带混合编解码器以及TCN后端,以实现内存高效的流式处理。通过学习型跳过与门控融合技术结合频谱-时序损失进一步优化重建效果。该模型在VoiceBank-DEMAND数据集上进行训练(混入录制的无人机噪声,信噪比为-5至-25dB),并使用标准语音增强指标和计算效率进行评估。实验结果表明,DroFiT 在实现竞争性的语音增强性能的同时显著降低了计算需求和内存占用,为资源受限的无人机平台上的实时处理铺平了道路。音频演示样本可在我们的展示页面上获取。

URL

https://arxiv.org/abs/2509.16945

PDF

https://arxiv.org/pdf/2509.16945.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot