Paper Reading AI Learner

SPOT!: Map-Guided LLM Agent for Unsupervised Multi-CCTV Dynamic Object Tracking

2025-12-24 06:04:58
Yujin Noh, Inho Jake Park, Chigon Hwang

Abstract

CCTV-based vehicle tracking systems face structural limitations in continuously connecting the trajectories of the same vehicle across multiple camera environments. In particular, blind spots occur due to the intervals between CCTVs and limited Fields of View (FOV), which leads to object ID switching and trajectory loss, thereby reducing the reliability of real-time path prediction. This paper proposes SPOT (Spatial Prediction Over Trajectories), a map-guided LLM agent capable of tracking vehicles even in blind spots of multi-CCTV environments without prior training. The proposed method represents road structures (Waypoints) and CCTV placement information as documents based on 2D spatial coordinates and organizes them through chunking techniques to enable real-time querying and inference. Furthermore, it transforms the vehicle's position into the actual world coordinate system using the relative position and FOV information of objects observed in CCTV images. By combining map spatial information with the vehicle's moving direction, speed, and driving patterns, a beam search is performed at the intersection level to derive candidate CCTV locations where the vehicle is most likely to enter after the blind spot. Experimental results based on the CARLA simulator in a virtual city environment confirmed that the proposed method accurately predicts the next appearing CCTV even in blind spot sections, maintaining continuous vehicle trajectories more effectively than existing techniques.

Abstract (translated)

基于CCTV的车辆追踪系统在跨多个摄像头环境持续连接同一辆车轨迹时面临结构性限制。特别是,由于摄像头之间的间隔和有限的视野(FOV),会产生盲点区域,导致物体ID切换及轨迹丢失,从而降低实时路径预测的可靠性。本文提出了SPOT(轨迹上的空间预测)方法,这是一种基于地图引导的大规模语言模型代理,能够在没有前期训练的情况下,在多CCTV环境中的盲点区域内追踪车辆。所提出的方法将道路结构(路标)和CCTV安装信息以文档的形式表示在二维空间坐标上,并通过分块技术组织这些信息,以便于实时查询和推理。 此外,该方法利用CCTV图像中观察到的物体相对位置及视野信息,将车辆的位置转换为实际世界坐标系统。结合地图的空间信息、车辆行驶方向、速度以及驾驶模式,在交叉路口级别进行束搜索以确定车辆在盲点区域之后最有可能进入的候选CCTV位置。 基于虚拟城市环境中CARLA模拟器的实验结果表明,所提出的方法能够准确预测下一个出现的CCTV(即使在盲点区域内),比现有的技术更有效地保持连续的车辆轨迹。

URL

https://arxiv.org/abs/2512.20975

PDF

https://arxiv.org/pdf/2512.20975.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot