Paper Reading AI Learner

From Detection to Association: Learning Discriminative Object Embeddings for Multi-Object Tracking

2025-12-02 04:04:39
Yuqing Shao, Yuchen Yang, Rui Yu, Weilong Li, Xu Guo, Huaicheng Yan, Wei Wang, Xiao Sun

Abstract

End-to-end multi-object tracking (MOT) methods have recently achieved remarkable progress by unifying detection and association within a single framework. Despite their strong detection performance, these methods suffer from relatively low association accuracy. Through detailed analysis, we observe that object embeddings produced by the shared DETR architecture display excessively high inter-object similarity, as it emphasizes only category-level discrimination within single frames. In contrast, tracking requires instance-level distinction across frames with spatial and temporal continuity, for which current end-to-end approaches insufficiently optimize object embeddings. To address this, we introduce FDTA (From Detection to Association), an explicit feature refinement framework that enhances object discriminativeness across three complementary perspectives. Specifically, we introduce a Spatial Adapter (SA) to integrate depth-aware cues for spatial continuity, a Temporal Adapter (TA) to aggregate historical information for temporal dependencies, and an Identity Adapter (IA) to leverage quality-aware contrastive learning for instance-level separability. Extensive experiments demonstrate that FDTA achieves state-of-the-art performance on multiple challenging MOT benchmarks, including DanceTrack, SportsMOT, and BFT, highlighting the effectiveness of our proposed discriminative embedding enhancement strategy. The code is available at this https URL.

Abstract (translated)

最近,端到端的多目标跟踪(MOT)方法通过在单一框架内统一检测和关联取得了显著进展。尽管这些方法具有强大的检测性能,但在关联准确性方面仍然存在相对较低的表现。经过详细分析,我们发现由共享DETR架构生成的对象嵌入表现出过高的对象间相似性,因为这种架构仅强调单帧内的类别级别区分。相比之下,跟踪要求跨帧在空间和时间连续性上进行实例级别的区别,而当前的端到端方法对优化对象嵌入不足。 为了解决这个问题,我们提出了FDTA(从检测到关联),这是一种显式的特征增强框架,它通过三个互补的角度增强了对象的区分度。具体来说,我们引入了空间适配器(SA)来整合深度感知线索以实现空间连续性、时间适配器(TA)来聚合历史信息以捕捉时间依赖关系以及身份适配器(IA),用于利用质量感知对比学习增强实例级别的可分离性。 广泛的实验表明,FDTA在多个具有挑战性的MOT基准测试中取得了最先进的性能,包括DanceTrack、SportsMOT和BFT。这突显了我们提出的区分式嵌入增强策略的有效性。代码可在[此处](https://this-url.com)获取。

URL

https://arxiv.org/abs/2512.02392

PDF

https://arxiv.org/pdf/2512.02392.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot