Abstract
Monitoring aerial objects is crucial for security, wildlife conservation, and environmental studies. Traditional RGB-based approaches struggle with challenges such as scale variations, motion blur, and high-speed object movements, especially for small flying entities like insects and drones. In this work, we explore the potential of event-based vision for detecting and recognizing flying objects, in particular animals that may not follow short and long-term predictable patters. Event cameras offer high temporal resolution, low latency, and robustness to motion blur, making them well-suited for this task. We introduce EV-Flying, an event-based dataset of flying objects, comprising manually annotated birds, insects and drones with spatio-temporal bounding boxes and track identities. To effectively process the asynchronous event streams, we employ a point-based approach leveraging lightweight architectures inspired by PointNet. Our study investigates the classification of flying objects using point cloud-based event representations. The proposed dataset and methodology pave the way for more efficient and reliable aerial object recognition in real-world scenarios.
Abstract (translated)
监测空中物体对于安全、野生动物保护和环境研究至关重要。传统基于RGB的方法在面对尺度变化、运动模糊以及高速移动目标(特别是像昆虫和无人机这样的小型飞行实体)时,面临诸多挑战。在这项工作中,我们探索了事件驱动视觉在检测和识别飞行物体方面的潜力,尤其是那些不遵循短期或长期可预测模式的动物。事件相机提供高时间分辨率、低延迟及对运动模糊的强大抵抗力,非常适合此类任务。我们介绍了EV-Flying,这是一个基于事件的飞行物数据集,包含手动标注的鸟类、昆虫和无人机,并带有空间-时间边界框和轨迹标识。为了有效处理异步事件流,我们采用了一种点基方法,借鉴轻量级架构如PointNet的设计思想。我们的研究探讨了使用点云表示法进行飞行物体分类的方法。所提出的数据集和方法为在现实场景中实现更高效、可靠的空中目标识别铺平了道路。
URL
https://arxiv.org/abs/2506.04048