Abstract
Small, fast, and lightweight drones present significant challenges for traditional RGB cameras due to their limitations in capturing fast-moving objects, especially under challenging lighting conditions. Event cameras offer an ideal solution, providing high temporal definition and dynamic range, yet existing benchmarks often lack fine temporal resolution or drone-specific motion patterns, hindering progress in these areas. This paper introduces the Florence RGB-Event Drone dataset (FRED), a novel multimodal dataset specifically designed for drone detection, tracking, and trajectory forecasting, combining RGB video and event streams. FRED features more than 7 hours of densely annotated drone trajectories, using 5 different drone models and including challenging scenarios such as rain and adverse lighting conditions. We provide detailed evaluation protocols and standard metrics for each task, facilitating reproducible benchmarking. The authors hope FRED will advance research in high-speed drone perception and multimodal spatiotemporal understanding.
Abstract (translated)
小型、快速且轻量级的无人机给传统的RGB相机带来了显著挑战,因为它们在捕捉高速移动对象方面存在局限性,尤其是在光照条件复杂的情况下。事件相机提供了一个理想的解决方案,能够提供高时间分辨率和动态范围,但现有的基准测试通常缺乏精细的时间分辨率或针对无人机特定运动模式的数据,这阻碍了相关领域的进步。本文介绍了佛罗伦萨RGB-事件无人机数据集(FRED),这是一个专门用于无人机检测、跟踪和轨迹预测的新型多模态数据集,结合了RGB视频流和事件流。FRED包含了超过7小时密集注释的无人机轨迹数据,使用了5种不同的无人机型号,并涵盖了具有挑战性的场景,例如雨天及不良光照条件。我们提供了每项任务详细的评估协议和标准指标,以促进可重复基准测试的进行。作者希望FRED能够推动高速无人机感知以及多模态时空理解的研究进展。
URL
https://arxiv.org/abs/2506.05163