Abstract
Multi-object tracking (MOT) from unmanned aerial vehicles (UAVs) presents unique challenges due to unpredictable object motion, frequent occlusions, and limited appearance cues inherent to aerial viewpoints. These issues are further exacerbated by abrupt UAV movements, leading to unreliable trajectory estimation and identity switches. Conventional motion models, such as Kalman filters or static sequence encoders, often fall short in capturing both linear and non-linear dynamics under such conditions. To tackle these limitations, we propose DMTrack, a deformable motion tracking framework tailored for UAV-based MOT. Our DMTrack introduces three key components: DeformMamba, a deformable state-space predictor that dynamically aggregates historical motion states for adaptive trajectory modeling; MotionGate, a lightweight gating module that fuses Kalman and Mamba predictions based on motion context and uncertainty; and an uncertainty-aware association strategy that enhances identity preservation by aligning motion trends with prediction confidence. Extensive experiments on the VisDrone-MOT and UAVDT benchmarks demonstrate that our DMTrack achieves state-of-the-art performance in identity consistency and tracking accuracy, particularly under high-speed and non-linear motion. Importantly, our method operates without appearance models and maintains competitive efficiency, highlighting its practicality for robust UAV-based tracking.
Abstract (translated)
基于无人飞行器(UAV)的多目标跟踪(MOT)由于不可预测的目标运动、频繁遮挡以及空中视角固有的有限外观线索,面临着独特的挑战。这些问题还因无人机突然移动而加剧,导致轨迹估计不准确和身份切换。传统的运动模型,如卡尔曼滤波或静态序列编码器,在这种条件下捕捉线性和非线性动态时通常效果不佳。为了解决这些限制,我们提出了DMTrack,这是一个专为基于UAV的MOT设计的可变形运动跟踪框架。我们的DMTrack引入了三个关键组件:DeformMamba,一个可变形状态空间预测器,它根据历史运动状态进行自适应轨迹建模;MotionGate,一个轻量级门控模块,可以根据运动上下文和不确定性融合卡尔曼滤波和Mamba的预测;以及一种不确定性感知关联策略,通过将运动趋势与预测信心对齐来增强身份保持。在VisDrone-MOT和UAVDT基准测试中进行的广泛实验表明,我们的DMTrack在身份一致性和跟踪准确性方面达到了最先进的水平,特别是在高速度和非线性运动的情况下。重要的是,我们的方法不依赖于外观模型,并且保持了竞争性的效率,突显了其作为鲁棒基于UAV的跟踪的实际应用价值。
URL
https://arxiv.org/abs/2510.17860