Abstract
This paper introduces an autonomous UAV vision system for continuous, real-time tracking of marine animals, specifically sharks, in dynamic marine environments. The system integrates an onboard computer with a stabilised RGB-D camera and a custom-trained OSTrack pipeline, enabling visual identification under challenging lighting, occlusion, and sea-state conditions. A key innovation is the inter-UAV handoff protocol, which enables seamless transfer of tracking responsibilities between drones, extending operational coverage beyond single-drone battery limitations. Performance is evaluated on a curated shark dataset of 5,200 frames, achieving a tracking success rate of 81.9\% during real-time flight control at 100 Hz, and robustness to occlusion, illumination variation, and background clutter. We present a seamless UAV handoff framework, where target transfer is attempted via high-confidence feature matching, achieving 82.9\% target coverage. These results confirm the viability of coordinated UAV operations for extended marine tracking and lay the groundwork for scalable, autonomous monitoring.
Abstract (translated)
本文介绍了一种自主无人飞行器(UAV)视觉系统,用于在动态海洋环境中连续、实时追踪海洋动物,特别是鲨鱼。该系统将机载计算机与稳定化的RGB-D相机和经过定制训练的OSTrack管道集成在一起,能够在具有挑战性的光照条件、遮挡以及海况下进行视觉识别。一个关键创新是无人机之间的交接协议,使跟踪责任可以在不同无人机之间无缝转移,从而在单个无人机电池限制之外延长操作范围。 该系统的性能通过一组精心挑选的包含5,200帧的鲨鱼数据集进行了评估,在实时飞行控制中以100 Hz频率运行时,追踪成功率为81.9%,并且对遮挡、光照变化以及背景杂乱具有良好的鲁棒性。我们提出了一种无缝无人机交接框架,在此框架下通过高置信度特征匹配尝试目标转移,实现82.9%的目标覆盖范围。 这些结果确认了协调的UAV操作在扩展海洋追踪中的可行性,并为可扩展、自主监测系统奠定了基础。
URL
https://arxiv.org/abs/2507.12763