Abstract
This paper presents a novel three-stage framework for real-time foreign object intrusion (FOI) detection and tracking in power transmission systems. The framework integrates: (1) a YOLOv7 segmentation model for fast and robust object localization, (2) a ConvNeXt-based feature extractor trained with triplet loss to generate discriminative embeddings, and (3) a feature-assisted IoU tracker that ensures resilient multi-object tracking under occlusion and motion. To enable scalable field deployment, the pipeline is optimized for deployment on low-cost edge hardware using mixed-precision inference. The system supports incremental updates by adding embeddings from previously unseen objects into a reference database without requiring model retraining. Extensive experiments on real-world surveillance and drone video datasets demonstrate the framework's high accuracy and robustness across diverse FOI scenarios. In addition, hardware benchmarks on NVIDIA Jetson devices confirm the framework's practicality and scalability for real-world edge applications.
Abstract (translated)
本文提出了一种新颖的三阶段框架,用于电力传输系统中实时异物入侵(FOI)检测和跟踪。该框架整合了以下三个部分: 1. 一个基于YOLOv7的分割模型,用于快速且稳健的对象定位; 2. 基于ConvNeXt的特征提取器,并使用三元组损失进行训练,以生成具有区分性的嵌入向量; 3. 一种辅助特征的IoU跟踪器,在遮挡和运动情况下确保多对象跟踪的鲁棒性。 为了实现可扩展的实际部署,该流程被优化为可以在低成本边缘硬件上使用混合精度推理进行部署。系统支持增量更新,通过将来自之前未见过的对象的嵌入添加到参考数据库中来完成,而无需重新训练模型。在现实世界的监控和无人机视频数据集上的广泛实验表明,该框架在各种FOI场景下具有高准确性和鲁棒性。 此外,在NVIDIA Jetson设备上进行的硬件基准测试确认了该框架的实际可行性和在边缘应用中的可扩展性。
URL
https://arxiv.org/abs/2509.13396