This paper presents a novel three-stage framework for real-time foreign object intrusion (FOI) detection and tracking in power transmission systems. The framework integrates: (1) a YOLOv7 segmentation model for fast and robust object localization, (2) a ConvNeXt-based feature extractor trained with triplet loss to generate discriminative embeddings, and (3) a feature-assisted IoU tracker that ensures resilient multi-object tracking under occlusion and motion. To enable scalable field deployment, the pipeline is optimized for deployment on low-cost edge hardware using mixed-precision inference. The system supports incremental updates by adding embeddings from previously unseen objects into a reference database without requiring model retraining. Extensive experiments on real-world surveillance and drone video datasets demonstrate the framework's high accuracy and robustness across diverse FOI scenarios. In addition, hardware benchmarks on NVIDIA Jetson devices confirm the framework's practicality and scalability for real-world edge applications.
本文提出了一种新颖的三阶段框架,用于电力传输系统中实时异物入侵(FOI)检测和跟踪。该框架整合了以下三个部分: 1. 一个基于YOLOv7的分割模型,用于快速且稳健的对象定位; 2. 基于ConvNeXt的特征提取器,并使用三元组损失进行训练,以生成具有区分性的嵌入向量; 3. 一种辅助特征的IoU跟踪器,在遮挡和运动情况下确保多对象跟踪的鲁棒性。 为了实现可扩展的实际部署,该流程被优化为可以在低成本边缘硬件上使用混合精度推理进行部署。系统支持增量更新,通过将来自之前未见过的对象的嵌入添加到参考数据库中来完成,而无需重新训练模型。在现实世界的监控和无人机视频数据集上的广泛实验表明,该框架在各种FOI场景下具有高准确性和鲁棒性。 此外,在NVIDIA Jetson设备上进行的硬件基准测试确认了该框架的实际可行性和在边缘应用中的可扩展性。
https://arxiv.org/abs/2509.13396
The endurance and energy efficiency of drones remain critical challenges in their design and operation. To extend mission duration, numerous studies explored perching mechanisms that enable drones to conserve energy by temporarily suspending flight. This paper presents a new perching drone that utilizes an active flexible perching mechanism inspired by the rapid predation mechanism of the Venus flytrap, achieving perching in less than 100 ms. The proposed system is designed for high-speed adaptability to the perching targets. The overall drone design is outlined, followed by the development and validation of the biomimetic perching structure. To enhance the system stability, a cascade extended high-gain observer (EHGO) based control method is developed, which can estimate and compensate for the external disturbance in real time. The experimental results demonstrate the adaptability of the perching structure and the superiority of the cascaded EHGO in resisting wind and perching disturbances.
无人机的续航能力和能源效率仍然是其设计和运行中的关键挑战。为了延长任务持续时间,许多研究探索了通过暂时停止飞行来节省能量的着陆机制。本文介绍了一种新的着陆无人机,该无人机采用了一种受捕蝇草快速捕食机制启发的主动灵活着陆机构,在不到100毫秒的时间内即可完成着陆动作。所提出的系统旨在对不同着陆目标实现高速适应性。 文章首先概述了整体无人机设计,然后详细介绍了仿生着陆结构的发展和验证过程。为了增强系统的稳定性,开发了一种基于级联扩展高增益观测器(EHGO)的控制方法,能够实时估计并补偿外部干扰。实验结果表明,该着陆结构具有良好的适应性,并且级联EHGO在抵抗风力及其他着陆干扰方面表现出色。
https://arxiv.org/abs/2509.13249
Small drones are an increasing threat to both military personnel and civilian infrastructure, making early and automated detection crucial. In this work we develop a system that uses spiking neural networks and neuromorphic cameras (event cameras) to detect drones. The detection model is deployed on a neuromorphic chip making this a fully neuromorphic system. Multiple detection units can be deployed to create a virtual tripwire which detects when and where drones enter a restricted zone. We show that our neuromorphic solution is several orders of magnitude more energy efficient than a reference solution deployed on an edge GPU, allowing the system to run for over a year on battery power. We investigate how synthetically generated data can be used for training, and show that our model most likely relies on the shape of the drone rather than the temporal characteristics of its propellers. The small size and low power consumption allows easy deployment in contested areas or locations that lack power infrastructure.
小型无人机对军事人员和民用基础设施构成了日益严重的威胁,因此早期且自动化的检测变得至关重要。在这项工作中,我们开发了一种使用脉冲神经网络(SNN)和神经形态相机(事件相机)来探测无人机的系统。该检测模型部署在神经形态芯片上,使得整个系统完全基于神经形态技术。可以部署多个检测单元以创建一个虚拟警戒线,在无人机进入限制区域时对其进行检测。我们展示了我们的神经形态解决方案比参考方案在边缘GPU上的部署要高效几个数量级,这使得该系统仅依靠电池供电就能运行超过一年的时间。我们还研究了如何使用合成生成的数据进行训练,并发现我们的模型很可能依赖于无人机的形状而非其螺旋桨的动态特性。由于体积小且耗电低,这种解决方案便于在对抗环境中或缺乏电力基础设施的地方部署。
https://arxiv.org/abs/2509.12997
Efficient deployment of deep learning models for aerial object detection on resource-constrained devices requires significant compression without com-promising performance. In this study, we propose a novel three-stage compression pipeline for the YOLOv8 object detection model, integrating sparsity-aware training, structured channel pruning, and Channel-Wise Knowledge Distillation (CWD). First, sparsity-aware training introduces dynamic sparsity during model optimization, effectively balancing parameter reduction and detection accuracy. Second, we apply structured channel pruning by leveraging batch normalization scaling factors to eliminate redundant channels, significantly reducing model size and computational complexity. Finally, to mitigate the accuracy drop caused by pruning, we employ CWD to transfer knowledge from the original model, using an adjustable temperature and loss weighting scheme tailored for small and medium object detection. Extensive experiments on the VisDrone dataset demonstrate the effectiveness of our approach across multiple YOLOv8 variants. For YOLOv8m, our method reduces model parameters from 25.85M to 6.85M (a 73.51% reduction), FLOPs from 49.6G to 13.3G, and MACs from 101G to 34.5G, while reducing AP50 by only 2.7%. The resulting compressed model achieves 47.9 AP50 and boosts inference speed from 26 FPS (YOLOv8m baseline) to 45 FPS, enabling real-time deployment on edge devices. We further apply TensorRT as a lightweight optimization step. While this introduces a minor drop in AP50 (from 47.9 to 47.6), it significantly improves inference speed from 45 to 68 FPS, demonstrating the practicality of our approach for high-throughput, re-source-constrained scenarios.
在资源受限设备上高效部署深度学习模型以进行航空目标检测,需要大幅压缩模型而不会牺牲性能。本文提出了一种新颖的三阶段压缩管道,用于YOLOv8对象检测模型,并整合了稀疏感知训练、结构化通道裁剪以及通道级知识蒸馏(CWD)。首先,稀疏感知训练在模型优化过程中引入动态稀疏性,有效地平衡参数减少和检测精度。其次,我们通过利用批归一化缩放因子来消除冗余通道,从而显著减小模型大小和计算复杂度来进行结构化通道裁剪。最后,为了缓解修剪引起的准确率下降,我们采用CWD从原始模型转移知识,使用可调温度和损失加权方案,专为小中型对象检测设计。 在VisDrone数据集上进行的大量实验验证了我们的方法对多个YOLOv8变体的有效性。对于YOLOv8m版本,我们的方法将模型参数减少了73.51%,从25.85M降至6.85M,并且将FLOPs(浮点运算次数)从49.6G减少到13.3G,MACs(乘加操作次数)从101G减少到34.5G,仅使AP50精度降低2.7%。压缩后的模型达到47.9 AP50,并将推断速度从基线YOLOv8m的每秒26帧提升至45帧,实现了在边缘设备上的实时部署。 此外,我们进一步应用了TensorRT作为轻量级优化步骤。虽然这导致AP50略微下降(从47.9降至47.6),但将推断速度显著提升到每秒68帧,展示出我们的方法对高吞吐量、资源受限场景的实用性。
https://arxiv.org/abs/2509.12918
Visual-inertial fusion is crucial for a large amount of intelligent and autonomous applications, such as robot navigation and augmented reality. To bootstrap and achieve optimal state estimation, the spatial-temporal displacements between IMU and cameras must be calibrated in advance. Most existing calibration methods adopt continuous-time state representation, more specifically the B-spline. Despite these methods achieve precise spatial-temporal calibration, they suffer from high computational cost caused by continuous-time state representation. To this end, we propose a novel and extremely efficient calibration method that unleashes the power of discrete-time state representation. Moreover, the weakness of discrete-time state representation in temporal calibration is tackled in this paper. With the increasing production of drones, cellphones and other visual-inertial platforms, if one million devices need calibration around the world, saving one minute for the calibration of each device means saving 2083 work days in total. To benefit both the research and industry communities, our code will be open-source.
视觉与惯性数据融合对于许多智能和自主应用至关重要,例如机器人导航和增强现实。为了启动并实现最优状态估计,必须提前校准IMU(惯性测量单元)与相机之间的空间-时间位移。大多数现有的校准方法采用连续时间的状态表示,具体来说是B样条曲线。尽管这些方法能够实现精准的空间-时间校准,但由于连续时间状态表示带来的高计算成本而存在不足。为此,我们提出了一种新型且极其高效的校准方法,该方法利用离散时间状态表示的优势。此外,本文还解决了离散时间状态表示在时间校准中的弱点问题。 随着无人机、手机及其他视觉惯性平台产量的增加,假设全球有100万台设备需要进行校准,每台设备节省一分钟意味着总体上可以省下2083个工作日。为了惠及科研和工业界社区,我们的代码将开源提供使用。
https://arxiv.org/abs/2509.12846
Cross-view geo-localization aims to determine the geographical location of a query image by matching it against a gallery of images. This task is challenging due to the significant appearance variations of objects observed from variable views, along with the difficulty in extracting discriminative features. Existing approaches often rely on extracting features through feature map segmentation while neglecting spatial and semantic information. To address these issues, we propose the EVA02-based Multi-scale Frequency Attention Fusion (MFAF) method. The MFAF method consists of Multi-Frequency Branch-wise Block (MFB) and the Frequency-aware Spatial Attention (FSA) module. The MFB block effectively captures both low-frequency structural features and high-frequency edge details across multiple scales, improving the consistency and robustness of feature representations across various viewpoints. Meanwhile, the FSA module adaptively focuses on the key regions of frequency features, significantly mitigating the interference caused by background noise and viewpoint variability. Extensive experiments on widely recognized benchmarks, including University-1652, SUES-200, and Dense-UAV, demonstrate that the MFAF method achieves competitive performance in both drone localization and drone navigation tasks.
跨视图地理定位旨在通过将查询图像与一组图像库进行匹配来确定其地理位置。这一任务具有挑战性,原因是观察到的对象在不同视角下的外观变化显著,并且提取有区分度的特征较为困难。现有方法通常依赖于通过分割特征图来提取特征,但往往忽略了空间和语义信息。 为了解决这些问题,我们提出了基于EVA02的多尺度频率注意力融合(MFAF)方法。该MFAF方法包括多频率分支块(Multi-Frequency Branch-wise Block, MFB)和频域感知的空间注意模块(Frequency-aware Spatial Attention, FSA)。MFB块能够有效捕捉多层次中的低频结构特征以及高频边缘细节,从而提升在各种视角下特征表示的一致性和鲁棒性。同时,FSA模块可以自适应地聚焦于频率特征的关键区域,显著减轻背景噪声和视角变化带来的干扰。 广泛的实验结果表明,在包括University-1652、SUES-200以及Dense-UAV等广泛认可的基准数据集上,MFAF方法在无人机定位和导航任务中取得了具有竞争力的表现。
https://arxiv.org/abs/2509.12673
Navigation is a fundamental capability in embodied AI, representing the intelligence required to perceive and interact within physical environments following language instructions. Despite significant progress in large Vision-Language Models (VLMs), which exhibit remarkable zero-shot performance on general vision-language tasks, their generalization ability in embodied navigation remains largely confined to narrow task settings and embodiment-specific architectures. In this work, we introduce a cross-embodiment and cross-task Navigation Foundation Model (NavFoM), trained on eight million navigation samples that encompass quadrupeds, drones, wheeled robots, and vehicles, and spanning diverse tasks such as vision-and-language navigation, object searching, target tracking, and autonomous driving. NavFoM employs a unified architecture that processes multimodal navigation inputs from varying camera configurations and navigation horizons. To accommodate diverse camera setups and temporal horizons, NavFoM incorporates identifier tokens that embed camera view information of embodiments and the temporal context of tasks. Furthermore, to meet the demands of real-world deployment, NavFoM controls all observation tokens using a dynamically adjusted sampling strategy under a limited token length budget. Extensive evaluations on public benchmarks demonstrate that our model achieves state-of-the-art or highly competitive performance across multiple navigation tasks and embodiments without requiring task-specific fine-tuning. Additional real-world experiments further confirm the strong generalization capability and practical applicability of our approach.
导航是具身人工智能(Embodied AI)中的一个基本能力,它代表了感知和在物理环境中根据语言指令进行互动所需的情报。尽管大型视觉-语言模型(VLMs)已经在一般的视觉-语言任务上展示了显著的零样本性能,但它们在具身导航中的泛化能力仍然主要局限于狭窄的任务设置和特定于具身化的架构。在这项工作中,我们引入了一个跨具身形式和跨任务的导航基础模型(NavFoM),该模型基于涵盖四足动物、无人机、轮式机器人和车辆等八个百万导航样本进行训练,并覆盖了诸如视觉-语言导航、物体搜索、目标跟踪及自主驾驶等多样化任务。NavFoM采用了一种统一架构,能够处理来自不同相机配置和导航范围的多模态导航输入。 为了适应多样化的相机设置和时间范围,NavFoM采用了标识令牌来嵌入具身形式的视图信息以及任务的时间背景。此外,为满足实际部署的需求,NavFoM在有限的标记长度预算下使用动态调整的采样策略来控制所有观察标记。在公开基准测试上的广泛评估表明,在无需特定任务微调的情况下,我们的模型在多个导航任务和具身形式上实现了最先进的或具有高度竞争力的表现。此外,真实世界的实验进一步证实了我们方法的强大泛化能力和实际应用性。
https://arxiv.org/abs/2509.12129
This paper investigates how the performance of visual navigation policies trained in simulation compares to policies trained with real-world data. Performance degradation of simulator-trained policies is often significant when they are evaluated in the real world. However, despite this well-known sim-to-real gap, we demonstrate that simulator-trained policies can match the performance of their real-world-trained counterparts. Central to our approach is a navigation policy architecture that bridges the sim-to-real appearance gap by leveraging pretrained visual representations and runs real-time on robot hardware. Evaluations on a wheeled mobile robot show that the proposed policy, when trained in simulation, outperforms its real-world-trained version by 31% and the prior state-of-the-art methods by 50% in navigation success rate. Policy generalization is verified by deploying the same model onboard a drone. Our results highlight the importance of diverse image encoder pretraining for sim-to-real generalization, and identify on-policy learning as a key advantage of simulated training over training with real data.
本文研究了在模拟环境中训练的视觉导航策略与使用真实世界数据训练的策略之间的性能比较。通常,当从模拟器中训练出来的策略被评估在现实世界时,其性能会显著下降。然而,尽管存在这种众所周知的“仿真到实际”差距,我们证明了通过特定方法,可以从模拟器中训练出的策略可以与使用真实数据训练出的策略达到相同的性能水平。 我们的方法核心在于一种导航政策架构,该架构利用预先训练好的视觉表示来弥补模拟环境和现实世界的外观差异,并且能够在机器人硬件上实时运行。在一台轮式移动机器人的评估显示,在模拟环境中训练的提议策略比同样模型使用真实数据训练的版本高出31%的成功率,同时比之前的最先进的方法提高了50%的导航成功率。 该政策的泛化能力通过将其部署到无人机上来验证。我们的研究结果强调了多样化的图像编码器预训练对于从仿真到实际环境中的一般化的重要性,并且指出基于策略的学习是模拟训练相对于使用真实数据训练的关键优势。
https://arxiv.org/abs/2509.11791
This paper presents an agent-based simulation model for coordinating battery recharging in drone swarms, focusing on applications in Internet of Things (IoT) and Industry 4.0 environments. The proposed model includes a detailed description of the simulation methodology, system architecture, and implementation. One practical use case is explored: Smart Farming, highlighting how autonomous coordination strategies can optimize battery usage and mission efficiency in large-scale drone deployments. This work uses a machine learning technique to analyze the agent-based simulation sensitivity analysis output results.
本文提出了一种基于代理的仿真模型,用于协调无人机群中的电池充电,在物联网(IoT)和工业4.0环境的应用中尤为关注。所提出的模型包括了对仿真方法、系统架构及实施细节的详细描述。文中探讨了一个实际应用场景:智能农业,展示了自主协调策略如何优化大规模无人机部署中的电池使用效率和任务执行效率。本研究利用机器学习技术来分析基于代理仿真的灵敏度分析结果输出。
https://arxiv.org/abs/2509.10867
Dense small objects in UAV imagery are often missed due to long-range viewpoints, occlusion, and clutter[cite: 5]. This paper presents a detector-agnostic post-processing framework that converts overlap-induced redundancy into group evidence[cite: 6]. Overlapping tiling first recovers low-confidence candidates[cite: 7]. A Spatial Gate (DBSCAN on box centroids) and a Semantic Gate (DBSCAN on ResNet-18 embeddings) then validates group evidence[cite: 7]. Validated groups receive controlled confidence reweighting before class-aware NMS fusion[cite: 8]. Experiments on VisDrone show a recall increase from 0.685 to 0.778 (+0.093) and a precision adjustment from 0.801 to 0.595, yielding F1=0.669[cite: 9]. Post-processing latency averages 0.095 s per image[cite: 10]. These results indicate recall-first, precision-trade-off behavior that benefits recall-sensitive applications such as far-field counting and monitoring[cite: 10]. Ablation confirms that tiling exposes missed objects, spatial clustering stabilizes geometry, semantic clustering enforces appearance coherence, and reweighting provides calibrated integration with the baseline[cite: 11]. The framework requires no retraining and integrates with modern detectors[cite: 12]. Future work will reduce semantic gating cost and extend the approach with temporal cues[cite: 13].
无人机(UAV)图像中的密集小物体由于长距离视角、遮挡和杂乱背景等原因常常被遗漏[cite: 5]。本文提出了一种与检测器无关的后处理框架,该框架将由重叠引起的冗余转换为群体证据[cite: 6]。首先通过重叠分块恢复低置信度候选物体[cite: 7]。然后使用空间门(基于目标框中心点进行DBSCAN聚类)和语义门(基于ResNet-18特征嵌入进行DBSCAN聚类)来验证群体证据的有效性[cite: 7]。经过验证的群体在置信度重新加权后,再通过类别感知的非极大值抑制(NMS)融合处理[cite: 8]。实验结果表明,在VisDrone数据集上的召回率从0.685提升至0.778 (+0.093),同时精度调整为0.595,得到了F1分数为0.669的表现[cite: 9]。后处理延迟平均为每张图像0.095秒[cite: 10]。这些结果显示了以召回率为先、牺牲部分精确度的特性,这在远距离计数和监控等需要高召回率的应用中尤为有益[cite: 10]。消融实验确认了分块可以发现被遗漏的对象,空间聚类可稳定几何关系,语义聚类则能确保外观一致性,并且重新加权提供了与基线模型的校准融合效果[cite: 11]。该框架无需重新训练即可与现代检测器集成使用[cite: 12]。未来的工作将致力于降低语义门的成本,并通过引入时间线索来扩展此方法的应用范围[cite: 13]。
https://arxiv.org/abs/2509.10779
This study addresses the escalating threat of branched broomrape (Phelipanche ramosa) to California's tomato industry, which supplies over 90 percent of U.S. processing tomatoes. The parasite's largely underground life cycle makes early detection difficult, while conventional chemical controls are costly, environmentally harmful, and often ineffective. To address this, we combined drone-based multispectral imagery with Long Short-Term Memory (LSTM) deep learning networks, using the Synthetic Minority Over-sampling Technique (SMOTE) to handle class imbalance. Research was conducted on a known broomrape-infested tomato farm in Woodland, Yolo County, CA, across five key growth stages determined by growing degree days (GDD). Multispectral images were processed to isolate tomato canopy reflectance. At 897 GDD, broomrape could be detected with 79.09 percent overall accuracy and 70.36 percent recall without integrating later stages. Incorporating sequential growth stages with LSTM improved detection substantially. The best-performing scenario, which integrated all growth stages with SMOTE augmentation, achieved 88.37 percent overall accuracy and 95.37 percent recall. These results demonstrate the strong potential of temporal multispectral analysis and LSTM networks for early broomrape detection. While further real-world data collection is needed for practical deployment, this study shows that UAV-based multispectral sensing coupled with deep learning could provide a powerful precision agriculture tool to reduce losses and improve sustainability in tomato production.
这项研究针对加州番茄行业面临的分支列当(Phelipanche ramosa)威胁日益严重的情况,该地区提供了美国超过90%的加工番茄。这种寄生植物主要在地下生长,使得早期检测变得困难;而传统的化学控制方法成本高昂、环境有害且往往无效。为了应对这一挑战,我们结合了基于无人机的多光谱成像技术和长短期记忆(LSTM)深度学习网络,并使用合成少数类过采样技术(SMOTE)来处理类别不平衡问题。研究在加州尤洛县伍德兰的一个已知受列当感染的番茄农场进行,跨越五个关键生长期,这些生长期由生长度日(GDD)确定。多光谱图像经过处理以隔离番茄冠层反射率。 在897 GDD时,在不整合后续阶段的情况下,可以以79.09%的整体准确性和70.36%的召回率检测到列当。结合LSTM网络和多个生长阶段后,检测效果显著提升。最佳性能情景是在所有生长期中使用SMOTE增强技术,整体准确性达到88.37%,召回率达到95.37%。 这些结果表明,在列当早期检测方面,时间序列多光谱分析与LSTM网络具有巨大潜力。尽管需要进一步收集实际数据以实现实用部署,但该研究显示,基于无人机的多光谱传感技术结合深度学习可以成为减少损失和提高番茄生产的可持续性的重要精准农业工具。
https://arxiv.org/abs/2509.09972
We introduce a multi-modal WAVE-DETR drone detector combining visible RGB and acoustic signals for robust real-life UAV object detection. Our approach fuses visual and acoustic features in a unified object detector model relying on the Deformable DETR and Wav2Vec2 architectures, achieving strong performance under challenging environmental conditions. Our work leverage the existing Drone-vs-Bird dataset and the newly generated ARDrone dataset containing more than 7,500 synchronized images and audio segments. We show how the acoustic information is used to improve the performance of the Deformable DETR object detector on the real ARDrone dataset. We developed, trained and tested four different fusion configurations based on a gated mechanism, linear layer, MLP and cross attention. The Wav2Vec2 acoustic embeddings are fused with the multi resolution feature mappings of the Deformable DETR and enhance the object detection performance over all drones dimensions. The best performer is the gated fusion approach, which improves the mAP of the Deformable DETR object detector on our in-distribution and out-of-distribution ARDrone datasets by 11.1% to 15.3% for small drones across all IoU thresholds between 0.5 and 0.9. The mAP scores for medium and large drones are also enhanced, with overall gains across all drone sizes ranging from 3.27% to 5.84%.
我们介绍了一种结合可见光RGB和声学信号的多模态WAVE-DETR无人机检测器,用于在现实生活中进行稳健的UAV(无人飞行器)目标检测。我们的方法在一个统一的目标检测模型中融合了视觉和听觉特征,该模型基于Deformable DETR和Wav2Vec2架构,在具有挑战性的环境条件下取得了卓越的表现。我们的工作利用现有的Drone-vs-Bird数据集以及新生成的包含超过7,500个同步图像和音频片段的ARDrone数据集。 我们展示了声学信息是如何在真实世界的ARDrone数据集中提高Deformable DETR目标检测器性能的。基于门控机制、线性层、多层感知机(MLP)和交叉注意力,我们开发并测试了四种不同的融合配置。Wav2Vec2声学嵌入与Deformable DETR的多分辨率特征映射相融合,并在所有无人机尺寸上增强了目标检测性能。 表现最佳的是门控融合方法,在我们的分布内和分布外ARDrone数据集中,对于小型无人机而言,它使Deformable DETR目标检测器在IoU(交并比)阈值为0.5至0.9的所有阈值下的mAP提高了11.1%到15.3%。中型和大型无人机的mAP评分也得到了增强,在所有无人机尺寸上的总体改进范围从3.27%到5.84%不等。
https://arxiv.org/abs/2509.09859
Accurate human trajectory prediction is crucial for robotics navigation and autonomous driving. Recent research has demonstrated that incorporating goal guidance significantly enhances prediction accuracy by reducing uncertainty and leveraging prior knowledge. Most goal-guided approaches decouple the prediction task into two stages: goal prediction and subsequent trajectory completion based on the predicted goal, which operate at extreme granularities: coarse-grained goal prediction forecasts the overall intention, while fine-grained trajectory completion needs to generate the positions for all future timesteps. The potential utility of intermediate temporal granularity remains largely unexplored, which motivates multi-granularity trajectory modeling. While prior work has shown that multi-granularity representations capture diverse scales of human dynamics and motion patterns, effectively integrating this concept into goal-guided frameworks remains challenging. In this paper, we propose MGTraj, a novel Multi-Granularity goal-guided model for human Trajectory prediction. MGTraj recursively encodes trajectory proposals from coarse to fine granularity levels. At each level, a transformer-based recursive refinement network (RRN) captures features and predicts progressive refinements. Features across different granularities are integrated using a weight-sharing strategy, and velocity prediction is employed as an auxiliary task to further enhance performance. Comprehensive experimental results in EHT/UCY and Stanford Drone Dataset indicate that MGTraj outperforms baseline methods and achieves state-of-the-art performance among goal-guided methods.
准确的人类轨迹预测对于机器人导航和自动驾驶至关重要。近期的研究表明,通过引入目标引导可以显著提高预测精度,减少不确定性,并利用先验知识。大多数目标导向的方法将预测任务分解为两个阶段:首先进行目标预测,然后根据已预测的目标来完成后续的轨迹生成。这两个阶段在粒度上存在极端差异:粗粒度的目标预测用于预测总体意图,而细粒度的轨迹完成则需要生成所有未来时间步长的位置信息。然而,中间时间粒度的潜在价值仍未被充分探索,这促使了多粒度轨迹建模的需求。尽管先前的工作已经展示了多粒度表示能够捕捉到人类动态和运动模式的不同尺度,但如何有效地将这一概念整合进目标导向框架中仍具有挑战性。 在本文中,我们提出了MGTraj(Multi-Granularity goal-guided Trajectory prediction),这是一种新颖的多粒度目标引导的人类轨迹预测模型。MGTraj通过递归编码从粗到细的不同粒度层级的轨迹提案来工作。在每个粒度层次上,基于变压器的递归细化网络(RRN)捕获特征并进行逐步精细化预测。不同粒度级别的特性利用权重共享策略进行整合,并且采用速度预测作为辅助任务进一步提升性能。 全面实验结果显示,在EHT/UCY和Stanford Drone数据集中,MGTraj在基线方法中表现出色,并且在目标导向的方法中达到了最先进的性能水平。
https://arxiv.org/abs/2509.09200
The demand for lightweight and high-strength composite structures is rapidly growing in aerospace and robotics, particularly for optimized drone frames. However, conventional composite manufacturing methods struggle to achieve complex 3D architectures for weight savings and rely on assembling separate components, which introduce weak points at the joints. Additionally, maintaining continuous fiber reinforcement remains challenging, limiting structural efficiency. In this study, we demonstrate the lightweight Face Centered Cubic (FFC) lattice structured conceptualization of drone frames for weight reduction and complex topology fabrication through 3D Fiber Tethering (3DFiT) using continuous single tow fiber ensuring precise fiber alignment, eliminating weak points associated with traditional composite assembly. Mechanical testing demonstrates that the fabricated drone frame exhibits a high specific strength of around four to eight times the metal and thermoplastic, outperforming other conventional 3D printing methods. The drone frame weighs only 260 g, making it 10% lighter than the commercial DJI F450 frame, enhancing structural integrity and contributing to an extended flight time of three minutes, while flight testing confirms its stability and durability under operational conditions. The findings demonstrate the potential of single tow lattice truss-based drone frames, with 3DFiT serving as a scalable and efficient manufacturing method.
在航空航天和机器人技术领域,对轻质高强度复合结构的需求正在迅速增长,特别是在优化无人机框架方面。然而,传统的复合材料制造方法难以实现复杂的三维架构以节省重量,并且通常需要组装单独的组件,这会在接头处引入弱点。此外,保持连续纤维增强也颇具挑战性,从而限制了结构效率。在这项研究中,我们展示了通过使用3D纤维牵引(3DFiT)技术来构思无人机框架的轻质面心立方(FFC)晶格结构概念,该方法利用连续单股纤维确保精确的纤维对齐,并消除了传统复合材料组装带来的弱点。机械测试表明,制造出的无人机框架具有较高的比强度,大约是金属和热塑性材料的四到八倍,超过了其他传统的3D打印方法的表现。这种无人机框架仅重260克,比商用的大疆F450框架轻10%,增强了结构完整性,并有助于飞行时间延长三分钟。此外,飞行测试证实了它在操作条件下的稳定性和耐用性。研究结果表明,基于单股纤维晶格的无人机框架具有潜力,而3DFiT则作为一种可扩展且高效的制造方法被提出。
https://arxiv.org/abs/2509.09024
Multispectral remote sensing object detection is one of the important application of unmanned aerial vehicle (UAV). However, it faces three challenges. Firstly, the low-light remote sensing images reduce the complementarity during multi-modality fusion. Secondly, the local small target modeling is interfered with redundant information in the fusion stage easily. Thirdly, due to the quadratic computational complexity, it is hard to apply the transformer-based methods on the UAV platform. To address these limitations, motivated by Mamba with linear complexity, a UAV multispectral object detector with dual-domain enhancement and priority-guided mamba fusion (DEPF) is proposed. Firstly, to enhance low-light remote sensing images, Dual-Domain Enhancement Module (DDE) is designed, which contains Cross-Scale Wavelet Mamba (CSWM) and Fourier Details Recovery block (FDR). CSWM applies cross-scale mamba scanning for the low-frequency components to enhance the global brightness of images, while FDR constructs spectrum recovery network to enhance the frequency spectra features for recovering the texture-details. Secondly, to enhance local target modeling and reduce the impact of redundant information during fusion, Priority-Guided Mamba Fusion Module (PGMF) is designed. PGMF introduces the concept of priority scanning, which starts from local targets features according to the priority scores obtained from modality difference. Experiments on DroneVehicle dataset and VEDAI dataset reports that, DEPF performs well on object detection, comparing with state-of-the-art methods. Our code is available in the supplementary material.
https://arxiv.org/abs/2509.07327
In various scenarios such as multi-drone surveillance and search-and-rescue operations, deploying multiple robots is essential to accomplish multiple tasks at once. Due to the limited communication range of these vehicles, a decentralised task allocation algorithm is crucial for effective task distribution among robots. The consensus-based bundle algorithm (CBBA) has been promising for multi-robot operation, offering theoretical guarantees. However, CBBA demands continuous communication, leading to potential congestion and packet loss that can hinder performance. In this study, we introduce an event-driven communication mechanism designed to address these communication challenges while maintaining the convergence and performance bounds of CBBA. We demonstrate theoretically that the solution quality matches that of CBBA and validate the approach with Monte-Carlo simulations across varying targets, agents, and bundles. Results indicate that the proposed algorithm (ED-CBBA) can reduce message transmissions by up to 52%.
在诸如多无人机监控和搜救操作等场景中,部署多个机器人以同时完成多项任务是至关重要的。由于这些车辆的通信范围有限,因此对于有效分配任务而言,去中心化的任务分配算法至关重要。基于共识的捆绑算法(CBBA)已被证明适用于多机器人作业,并提供了理论保障。然而,CBBA需要持续通信,这可能导致潜在的通信拥塞和数据包丢失,从而影响性能。在这项研究中,我们引入了一种事件驱动的通信机制,旨在解决这些通信挑战,同时保持CBBA的收敛性和性能界限。从理论上证明了所提出解决方案的质量与CBBA相匹配,并通过蒙特卡洛模拟在不同目标、代理和捆绑下的情况验证了该方法的有效性。结果表明,所提出的算法(ED-CBBA)可以将消息传输减少多达52%。
https://arxiv.org/abs/2509.06481
Automated inspection of transmission lines using UAVs is hindered by the difficulty of detecting small and ambiguous defects against complex backgrounds. Conventional detectors often suffer from detail loss due to strided downsampling, weak boundary sensitivity in lightweight backbones, and insufficient integration of global context with local cues. To address these challenges, we propose TinyDef-DETR, a DETR-based framework designed for small-defect detection. The method introduces a stride-free space-to-depth module for lossless downsampling, an edge-enhanced convolution for boundary-aware feature extraction, a cross-stage dual-domain multi-scale attention module to jointly capture global and local information, and a Focaler-Wise-SIoU regression loss to improve localization of small objects. Experiments conducted on the CSG-ADCD dataset demonstrate that TinyDef-DETR achieves substantial improvements in both precision and recall compared to competitive baselines, with particularly notable gains on small-object subsets, while incurring only modest computational overhead. Further validation on the VisDrone benchmark confirms the generalization capability of the proposed approach. Overall, the results indicate that integrating detail-preserving downsampling, edge-sensitive representations, dual-domain attention, and difficulty-adaptive regression provides a practical and efficient solution for UAV-based small-defect inspection in power grids.
使用无人机进行输电线路自动化检测时,由于小而模糊的缺陷在复杂背景下的识别难度大,导致传统探测器经常因步幅下采样导致细节丢失、轻量级骨干网络边界敏感性弱以及全局上下文与局部线索整合不足等问题。为解决这些挑战,我们提出了一种基于DETR框架的方法——TinyDef-DETR,专门用于小缺陷检测。该方法引入了无步幅的空间到深度模块以实现无损下采样,增强了边缘的卷积操作以提高边界感知特征提取能力,并设计了一个跨阶段双域多尺度注意力模块来共同捕捉全局和局部信息;此外还采用了Focaler-Wise-SIoU回归损失函数来改进小目标定位。在CSG-ADCD数据集上的实验表明,相较于竞争基线模型,TinyDef-DETR在精度和召回率上均取得了显著改善,尤其是在处理小对象子集方面表现尤为突出,并且仅增加了轻微的计算开销。进一步在VisDrone基准测试中的验证确认了所提方法具有良好的泛化能力。总体而言,研究结果表明,在无人机输电线路小缺陷检测中,将细节保留下采样、边缘敏感表示、双域注意力和难度适应性回归相结合提供了一种实用且高效的解决方案。
https://arxiv.org/abs/2509.06035
Open-Vocabulary Object Detection (OVD) has emerged as a pivotal technology for applications involving Unmanned Aerial Vehicles (UAVs). However, the prevailing large-scale datasets for OVD pre-training are predominantly composed of ground-level, natural images. This creates a significant domain gap, causing models trained on them to exhibit a substantial drop in performance on UAV imagery. To address this limitation, we first propose a refined UAV-Label engine. Then we construct and introduce UAVDE-2M(contains over 2,000,000 instances and 1800 categories) and UAVCAP-15k(contains over 15,000 images). Furthermore, we propose a novel Cross-Attention Gated Enhancement Fusion (CAGE) module and integrate it into the YOLO-World-v2 architecture. Finally, extensive experiments on the VisDrone and SIMD datasets verify the effectiveness of our proposed method for applications in UAV-based imagery and remote sensing.
开放词汇物体检测(OVD)已成为涉及无人驾驶航空器(UAVs)应用的关键技术。然而,现有的大规模数据集用于OVD预训练主要是地面自然图像为主的,这造成了显著的领域差距,导致在UAV图像上性能大幅下降。为解决这一局限性,我们首先提出了一种精炼的UAV-Label引擎。然后构建并介绍了包含超过2,000,000个实例和1800类别的UAVDE-2M数据集以及包含超过15,000张图像的UAVCAP-15k数据集。此外,我们还提出了一种新颖的跨注意力门控增强融合(CAGE)模块,并将其集成到YOLO-World-v2架构中。最后,在VisDrone和SIMD数据集上的广泛实验验证了我们的方法在基于UAV图像和远程传感应用中的有效性。
https://arxiv.org/abs/2509.06011
The rapid proliferation of drones across various industries has introduced significant challenges related to privacy, security, and noise pollution. Current drone detection systems, primarily based on visual and radar technologies, face limitations under certain conditions, highlighting the need for effective acoustic-based detection methods. This paper presents a unique and comprehensive dataset of drone acoustic signatures, encompassing 32 different categories differentiated by brand and model. The dataset includes raw audio recordings, spectrogram plots, and Mel-frequency cepstral coefficient (MFCC) plots for each drone. Additionally, we introduce an interactive web application that allows users to explore this dataset by selecting specific drone categories, listening to the associated audio, and viewing the corresponding spectrogram and MFCC plots. This tool aims to facilitate research in drone detection, classification, and acoustic analysis, supporting both technological advancements and educational initiatives. The paper details the dataset creation process, the design and implementation of the web application, and provides experimental results and user feedback. Finally, we discuss potential applications and future work to expand and enhance the project.
各种行业中的无人机迅速普及带来了与隐私、安全和噪音污染相关的重大挑战。当前的无人机检测系统主要依赖于视觉和雷达技术,在特定条件下存在局限性,这凸显了开发有效的基于声学的检测方法的需求。本文介绍了一个独特的全面的无人机声学特征数据集,涵盖了32个不同的类别,这些类别根据品牌和型号进行区分。该数据集包括每个无人机的原始音频记录、频谱图以及梅尔频率倒谱系数(MFCC)图。 此外,我们还推出了一款交互式网络应用程序,用户可以通过选择特定的无人机分类来探索这个数据集,聆听相关音频并查看相应的频谱图和MFCC图。这款工具旨在促进无人机检测、分类和声学分析的研究工作,并支持技术进步和教育计划的发展。本文详细介绍了数据集创建的过程、网络应用的设计与实现,并提供了实验结果和用户反馈。 最后,我们讨论了该项目的潜在应用场景以及未来的工作方向,以进一步扩展和完善项目内容。
https://arxiv.org/abs/2509.04715
The deployment of autonomous drone swarms in disaster response missions necessitates the development of flexible, scalable, and robust coordination systems. Traditional fixed architectures struggle to cope with dynamic and unpredictable environments, leading to inefficiencies in energy consumption and connectivity. This paper addresses this gap by proposing an adaptive architecture for drone swarms, leveraging a Large Language Model to dynamically select the optimal architecture as centralized, hierarchical, or holonic based on real time mission parameters such as task complexity, swarm size, and communication stability. Our system addresses the challenges of scalability, adaptability, and robustness,ensuring efficient energy consumption and maintaining connectivity under varying conditions. Extensive simulations demonstrate that our adaptive architecture outperforms traditional static models in terms of scalability, energy efficiency, and connectivity. These results highlight the potential of our approach to provide a scalable, adaptable, and resilient solution for real world disaster response scenarios.
在灾害响应任务中部署自主无人机群需要开发灵活、可扩展和强大的协调系统。传统的固定架构难以应对动态且不可预测的环境,导致能源消耗和连接效率低下。本文通过提出一种自适应的无人机群架构来解决这一问题,该架构利用大型语言模型根据实时任务参数(如任务复杂度、群组规模以及通信稳定性)动态选择最优化的集中式、分层或拟人式架构。 我们的系统解决了可扩展性、适应性和稳健性的挑战,确保在不同条件下的能源消耗效率和连接稳定。广泛的模拟实验表明,在可扩展性、能效和连接方面,我们提出的自适应架构优于传统的静态模型。这些结果突显了我们在实际灾害响应场景中提供一种可扩展、灵活且具有恢复力的解决方案的潜力。
https://arxiv.org/abs/2509.05355