Abstract
For precise, efficient, and safe drone landings, ground platforms should real-time, accurately locate descending drones and guide them to designated spots. While mmWave sensing combined with cameras improves localization accuracy, lower sampling frequency of traditional frame cameras compared to mmWave radar creates bottlenecks in system throughput. In this work, we upgrade traditional frame camera with event camera, a novel sensor that harmonizes in sampling frequency with mmWave radar within ground platform setup, and introduce mmE-Loc, a high-precision, low-latency ground localization system designed for precise drone landings. To fully exploit the \textit{temporal consistency} and \textit{spatial complementarity} between these two modalities, we propose two innovative modules: \textit{(i)} the Consistency-instructed Collaborative Tracking module, which further leverages the drone's physical knowledge of periodic micro-motions and structure for accurate measurements extraction, and \textit{(ii)} the Graph-informed Adaptive Joint Optimization module, which integrates drone motion information for efficient sensor fusion and drone localization. Real-world experiments conducted in landing scenarios with a drone delivery company demonstrate that mmE-Loc significantly outperforms state-of-the-art methods in both accuracy and latency.
Abstract (translated)
为了实现精确、高效和安全的无人机着陆,地面平台需要实时且准确地定位下降中的无人机,并引导其降落到指定位置。毫米波(mmWave)感应技术与摄像头结合虽然提高了定位精度,但传统帧相机相比毫米波雷达较低的采样频率成为系统吞吐量瓶颈。为此,我们在传统的帧相机基础上引入了事件相机(一种新型传感器),该传感器在地面平台设置中能够实现与毫米波雷达同步的采样频率,并推出mmE-Loc——一款专为精确无人机着陆设计的高精度、低延迟地面对准定位系统。 为了充分利用这两种模式之间的时间一致性与时空互补性,我们提出了两个创新模块:(i)协同追踪模块,该模块进一步利用了无人机周期微动和结构方面的物理知识以实现准确测量;(ii)基于图的信息自适应联合优化模块,该模块整合无人机运动信息,实现了高效的传感器融合及无人机定位。 在与一家无人机配送公司合作的实地实验中,我们发现mmE-Loc在精度和延迟方面均显著优于现有技术。
URL
https://arxiv.org/abs/2507.09469