Datasets are essential to train and evaluate computer vision models used for traffic analysis and to enhance road safety. Existing real datasets fit real-world scenarios, capturing authentic road object behaviors, however, they typically lack precise ground-truth annotations. In contrast, synthetic datasets play a crucial role, allowing for the annotation of a large number of frames without additional costs or extra time. However, a general drawback of synthetic datasets is the lack of realistic vehicle motion, since trajectories are generated using AI models or rule-based systems. In this work, we introduce R3ST (Realistic 3D Synthetic Trajectories), a synthetic dataset that overcomes this limitation by generating a synthetic 3D environment and integrating real-world trajectories derived from SinD, a bird's-eye-view dataset recorded from drone footage. The proposed dataset closes the gap between synthetic data and realistic trajectories, advancing the research in trajectory forecasting of road vehicles, offering both accurate multimodal ground-truth annotations and authentic human-driven vehicle trajectories.
数据集对于训练和评估用于交通分析及提高道路安全的计算机视觉模型至关重要。现有的真实数据集能够捕捉到现实世界中的场景,包括真实的道路物体行为,然而它们通常缺乏精确的真实标注信息。相比之下,合成数据集在标记大量帧方面发挥着重要作用,并且无需额外成本或时间消耗。但是,合成数据集的一个普遍缺点是缺少真实的车辆运动,因为轨迹通常是通过人工智能模型或基于规则的系统生成的。 在此研究中,我们引入了R3ST(Realistic 3D Synthetic Trajectories),这是一个合成数据集,它克服了上述限制,通过生成一个合成的三维环境,并将来自SinD的真实世界轨迹整合进去。SinD是一个从无人机拍摄到的鸟瞰图视频记录的数据集。所提出的数据集弥合了合成数据和现实轨迹之间的差距,在道路车辆轨迹预测的研究中取得进展,提供准确的多模态真实标注以及真实的由人类驾驶产生的车辆轨迹。
https://arxiv.org/abs/2512.16784
This paper proposes VLA-AN, an efficient and onboard Vision-Language-Action (VLA) framework dedicated to autonomous drone navigation in complex environments. VLA-AN addresses four major limitations of existing large aerial navigation models: the data domain gap, insufficient temporal navigation with reasoning, safety issues with generative action policies, and onboard deployment constraints. First, we construct a high-fidelity dataset utilizing 3D Gaussian Splatting (3D-GS) to effectively bridge the domain gap. Second, we introduce a progressive three-stage training framework that sequentially reinforces scene comprehension, core flight skills, and complex navigation capabilities. Third, we design a lightweight, real-time action module coupled with geometric safety correction. This module ensures fast, collision-free, and stable command generation, mitigating the safety risks inherent in stochastic generative policies. Finally, through deep optimization of the onboard deployment pipeline, VLA-AN achieves a robust real-time 8.3x improvement in inference throughput on resource-constrained UAVs. Extensive experiments demonstrate that VLA-AN significantly improves spatial grounding, scene reasoning, and long-horizon navigation, achieving a maximum single-task success rate of 98.1%, and providing an efficient, practical solution for realizing full-chain closed-loop autonomy in lightweight aerial robots.
本文提出了VLA-AN,这是一种高效且适合自主无人机在复杂环境中导航的视觉-语言-行动(Vision-Language-Action,简称VLA)框架。VLA-AN解决了现有大型空中导航模型面临的四大主要限制:数据领域差距、时间推理不足的导航问题、生成性行动策略的安全隐患以及机载部署的约束条件。具体来说: 首先,我们构建了一个高保真的数据集,采用3D高斯点画(3D Gaussian Splatting, 3D-GS)技术,有效地缩小了数据领域的差距。 其次,我们提出了一种渐进式的三阶段训练框架,该框架依次强化场景理解、核心飞行技能以及复杂导航能力的培养。 第三,我们设计了一个轻量级且实时的动作模块,并结合了几何安全校正。这一模块确保了快速生成无碰撞且稳定的指令,降低了随机性生成策略带来的固有安全性风险。 最后,通过深入优化机载部署管道,VLA-AN在资源受限的无人机上实现了8.3倍的强大实时推理吞吐量提升。 广泛的实验表明,与现有模型相比,VLA-AN显著提高了空间定位、场景理解以及长时展望导航的能力,并且单任务成功率最高可达98.1%。此外,它还为轻型空中机器人实现全链闭环自主提供了一个高效和实用的解决方案。
https://arxiv.org/abs/2512.15258
Infrared and visible image fusion is a pivotal technology in low-altitude UAV reconnaissance missions, providing high-quality data support for downstream tasks such as target detection and tracking by integrating thermal saliency with background texture this http URL, traditional no-reference metrics fail(Specifically,like Entropy (EN) and Average Gradient (AG)) in complex low-light environments. They often misinterpret high-frequency sensor noise as valid detail. This creates a "Noise Trap," paradoxically assigning higher scores to noisy images and misguiding fusion this http URL address this, we propose the Target-Background Contrast (TBC) metric. Inspired by Weber's Law, TBC focuses on the relative contrast of salient targets rather than global statistics. Unlike traditional metrics, TBC penalizes background noise and rewards target visibility. Experiments on the DroneVehicle dataset demonstrate that TBC aligns better with human perception and provides a reliable standard for low-altitude scenarios.
红外和可见光图像融合技术在低空无人机侦察任务中至关重要,通过将热显著性与背景纹理相结合,为下游的任务如目标检测和跟踪提供高质量的数据支持。然而,在复杂的低光照环境中,传统的无参考度量标准(例如熵(EN)和平均梯度(AG))常常失效。它们往往错误地将高频传感器噪声当作有效细节,从而陷入“噪声陷阱”,即对噪声图像给出更高的评分,并误导融合质量的评估。 为了解决这个问题,我们提出了目标-背景对比度(TBC)这一新的评价指标。TBC受到韦伯定律的启发,侧重于显著目标相对于背景的相对对比度,而非全局统计量。与传统度量标准不同的是,TBC会对背景噪声进行惩罚,并且在突出目标可见性方面给予奖励。 实验结果表明,在DroneVehicle数据集上,TBC更符合人类感知的标准,并为低空场景提供了可靠的评价基准。
https://arxiv.org/abs/2512.15211
We introduce a benchmark for system identification based on 75k real-world samples from the Crazyflie 2.1 Brushless nano-quadrotor, a sub-50g aerial vehicle widely adopted in robotics research. The platform presents a challenging testbed due to its multi-input, multi-output nature, open-loop instability, and nonlinear dynamics under agile maneuvers. The dataset comprises four aggressive trajectories with synchronized 4-dimensional motor inputs and 13-dimensional output measurements. To enable fair comparison of identification methods, the benchmark includes a suite of multi-horizon prediction metrics for evaluating both one-step and multi-step error propagation. In addition to the data, we provide a detailed description of the platform and experimental setup, as well as baseline models highlighting the challenge of accurate prediction under real-world noise and actuation nonlinearities. All data, scripts, and reference implementations are released as open-source at this https URL to facilitate transparent comparison of algorithms and support research on agile, miniaturized aerial robotics.
我们介绍了一个基于75000个来自Crazyflie 2.1无刷纳米四旋翼的真实世界样本的系统识别基准。该四旋翼重量不足50克,在机器人研究中被广泛采用。由于其多输入、多输出特性,开环不稳定性和在敏捷机动下的非线性动力学,平台提供了一个具有挑战性的测试环境。数据集包含四个激进轨迹,并同步记录了4维电机输入和13维输出测量值。为了公平地比较识别方法,该基准包括一系列多时间跨度预测指标,用于评估一步和多步误差传播的性能。除了数据之外,我们还提供了平台及实验设置的详细描述以及基线模型,以突出在真实世界噪声和执行非线性下的准确预测所面临的挑战。所有数据、脚本和参考实现均已作为开源代码在此[URL]发布,以便于算法透明比较并支持敏捷微型空中机器人的研究。
https://arxiv.org/abs/2512.14450
Training object detectors demands extensive, task-specific annotations, yet this requirement becomes impractical in UAV-based human detection due to constantly shifting target distributions and the scarcity of labeled images. As a remedy, synthetic simulators are adopted to generate annotated data, with a low annotation cost. However, the domain gap between synthetic and real images hinders the model from being effectively applied to the target domain. Accordingly, we introduce Coarse-to-Fine Hierarchical Alignment (CFHA), a three-stage diffusion-based framework designed to transform synthetic data for UAV-based human detection, narrowing the domain gap while preserving the original synthetic labels. CFHA explicitly decouples global style and local content domain discrepancies and bridges those gaps using three modules: (1) Global Style Transfer -- a diffusion model aligns color, illumination, and texture statistics of synthetic images to the realistic style, using only a small real reference set; (2) Local Refinement -- a super-resolution diffusion model is used to facilitate fine-grained and photorealistic details for the small objects, such as human instances, preserving shape and boundary integrity; (3) Hallucination Removal -- a module that filters out human instances whose visual attributes do not align with real-world data to make the human appearance closer to the target distribution. Extensive experiments on public UAV Sim2Real detection benchmarks demonstrate that our methods significantly improve the detection accuracy compared to the non-transformed baselines. Specifically, our method achieves up to $+14.1$ improvement of mAP50 on Semantic-Drone benchmark. Ablation studies confirm the complementary roles of the global and local stages and highlight the importance of hierarchical alignment. The code is released at \href{this https URL}{this url}.
训练目标检测器需要大量的、特定任务的标注数据,但在基于无人机的人类检测中,由于目标分布不断变化以及标记图像稀少,这一要求变得不切实际。作为解决方案,合成模拟器被用来生成有注释的数据,这大大降低了标注成本。然而,合成与真实图像之间的领域差距阻碍了模型在目标领域的有效应用。为此,我们引入了一种名为“粗到细层次对齐”(Coarse-to-Fine Hierarchical Alignment, CFHA)的三阶段扩散框架,旨在将合成数据转换为适用于基于无人机的人类检测,并缩小域间差异,同时保持原始标签信息不变。 CFHA明确地解耦了全局风格与局部内容领域的不一致,并通过三个模块来弥补这些差距:(1)全局样式迁移——一个扩散模型仅使用少量的真实参考集,就能将合成图像的颜色、光照和纹理统计特性对齐到真实样式的水平;(2)局部细化——一种超分辨率扩散模型被用来促进小物体(如人类实例)的细粒度和逼真细节,同时保持形状和边界的完整性;(3)幻觉移除——一个过滤模块将视觉属性与现实世界数据不一致的人类实例排除出去,使人类外观更接近目标分布。 在公共无人机Sim2Real检测基准上的广泛实验表明,我们的方法相比于未转换的基线显著提高了检测精度。具体而言,在Semantic-Drone基准上,我们的方法实现了高达+14.1 mAP50的改进。消融研究表明全局和局部阶段之间的互补作用,并强调了层次对齐的重要性。代码可在[此处](this https URL)获取。
https://arxiv.org/abs/2512.13869
Autonomous drone navigation in confined tubular environments remains a major challenge due to the constraining geometry of the conduits, the proximity of the walls, and the perceptual limitations inherent to such scenarios. We propose a reinforcement learning approach enabling a drone to navigate unknown three-dimensional tubes without any prior knowledge of their geometry, relying solely on local observations from LiDAR and a conditional visual detection of the tube center. In contrast, the Pure Pursuit algorithm, used as a deterministic baseline, benefits from explicit access to the centerline, creating an information asymmetry designed to assess the ability of RL to compensate for the absence of a geometric model. The agent is trained through a progressive Curriculum Learning strategy that gradually exposes it to increasingly curved geometries, where the tube center frequently disappears from the visual field. A turning-negotiation mechanism, based on the combination of direct visibility, directional memory, and LiDAR symmetry cues, proves essential for ensuring stable navigation under such partial observability conditions. Experiments show that the PPO policy acquires robust and generalizable behavior, consistently outperforming the deterministic controller despite its limited access to geometric information. Validation in a high-fidelity 3D environment further confirms the transferability of the learned behavior to a continuous physical dynamics. The proposed approach thus provides a complete framework for autonomous navigation in unknown tubular environments and opens perspectives for industrial, underground, or medical applications where progressing through narrow and weakly perceptive conduits represents a central challenge.
在受限的管状环境中,自主无人机导航仍然是一个重大挑战,这主要是由于管道几何结构的限制、墙壁间的距离以及这种场景中固有的感知限制。我们提出了一种强化学习方法,使无人机能够在没有管道几何知识的情况下仅通过LiDAR(激光雷达)的局部观测和条件视觉检测来探测管中心而进行未知三维管道内的导航。相比之下,作为确定性基准算法的纯追踪(Pure Pursuit)算法则可以明确访问到管道的中心线,这种信息不对称的设计旨在评估强化学习在没有几何模型的情况下补偿的能力。 通过渐进式课程学习策略对代理进行训练,该策略逐渐将其暴露于越来越弯曲的几何形状中,在此过程中管子中心经常从视觉区域消失。一种基于直接可见性、方向记忆和LiDAR(激光雷达)对称提示相结合的转弯协商机制被证明是确保在部分观察条件下稳定导航的关键。 实验表明,PPO(Proximal Policy Optimization,近端策略优化)政策能够获得稳健且具有泛化能力的行为,在几何信息有限的情况下依然优于确定性控制器。在一个高保真的3D环境中进行验证进一步确认了所学行为向连续物理动力学的可转移性。 因此,该方法提供了一个完整的自主导航框架以应对未知管状环境中的挑战,并为工业、地下或医疗应用中穿过狭窄且感知受限的管道这一核心问题打开了新的视角。
https://arxiv.org/abs/2512.10934
Most reinforcement learning(RL)-based methods for drone racing target fixed, obstacle-free tracks, leaving the generalization to unknown, cluttered environments largely unaddressed. This challenge stems from the need to balance racing speed and collision avoidance, limited feasible space causing policy exploration trapped in local optima during training, and perceptual ambiguity between gates and obstacles in depth maps-especially when gate positions are only coarsely specified. To overcome these issues, we propose a two-phase learning framework: an initial soft-collision training phase that preserves policy exploration for high-speed flight, followed by a hard-collision refinement phase that enforces robust obstacle avoidance. An adaptive, noise-augmented curriculum with an asymmetric actor-critic architecture gradually shifts the policy's reliance from privileged gate-state information to depth-based visual input. We further impose Lipschitz constraints and integrate a track-primitive generator to enhance motion stability and cross-environment generalization. We evaluate our framework through extensive simulation and ablation studies, and validate it in real-world experiments on a computationally constrained quadrotor. The system achieves agile flight while remaining robust to gate-position errors, developing a generalizable drone racing framework with the capability to operate in diverse, partially unknown and cluttered environments. this https URL
大多数基于强化学习(RL)的无人机竞速方法都针对固定且无障碍物的比赛轨道,对未知和复杂环境中的泛化能力几乎没有涉及。这一挑战源于需要平衡飞行速度与碰撞规避、受限的空间导致在训练过程中策略探索陷入局部最优解以及深度图中门和障碍物之间的感知模糊——特别是在门位置仅粗略指定的情况下尤为严重。 为了克服这些问题,我们提出了一种两阶段学习框架:初始的软碰撞训练阶段,在该阶段中保持了高速飞行中的策略探索;接着是一个硬碰撞细化阶段,强制执行稳健的障碍规避。一个自适应、噪声增强的教学大纲与不对称的演员-评论家架构相结合,逐渐让策略依赖从特权门状态信息转向基于深度视觉输入的信息。 我们进一步施加利普希茨(Lipschitz)约束并整合轨道元素生成器以提高运动稳定性以及跨环境泛化能力。通过广泛的仿真和消融研究对我们的框架进行了评估,并在计算资源有限的四旋翼无人机上进行实际验证实验,证明了该系统的有效性。 最终系统能够在保持鲁棒性的同时实现敏捷飞行,对于门位置误差具有良好的适应性,从而开发出一种通用化的无人机竞速框架,具备在多变、部分未知和拥挤环境中操作的能力。详情请参阅[原文链接]。
https://arxiv.org/abs/2512.09571
Cooperative suspended aerial transportation is highly susceptible to multi-source disturbances such as aerodynamic effects and thrust uncertainties. To achieve precise load manipulation, existing methods often rely on extra sensors to measure cable directions or the payload's pose, which increases the system cost and complexity. A fundamental question remains: is the payload's pose observable under multi-source disturbances using only the drones' odometry information? To answer this question, this work focuses on the two-drone-bar system and proves that the whole system is observable when only two or fewer types of lumped disturbances exist by using the observability rank criterion. To the best of our knowledge, we are the first to present such a conclusion and this result paves the way for more cost-effective and robust systems by minimizing their sensor suites. Next, to validate this analysis, we consider the situation where the disturbances are only exerted on the drones, and develop a composite disturbance filtering scheme. A disturbance observer-based error-state extended Kalman filter is designed for both state and disturbance estimation, which renders improved estimation performance for the whole system evolving on the manifold $(\mathbb{R}^3)^2\times(TS^2)^3$. Our simulation and experimental tests have validated that it is possible to fully estimate the state and disturbance of the system with only odometry information of the drones.
合作悬停空中运输系统极易受到气动效应和推力不确定性等多种源头的干扰。为了实现精确负载操作,现有方法通常依赖于额外传感器来测量电缆方向或载荷姿态,这增加了系统的成本与复杂度。一个基本问题是:仅使用无人机的里程计信息是否能观察到在多重干扰下的负载姿态?为了解决这个问题,本研究聚焦于双无人机吊杆系统,并利用可观测性秩准则证明了当存在两种或更少类型的耦合扰动时整个系统是可被观测的。据我们所知,这是首次提出此类结论的研究成果,它为构建成本更低且更为可靠的系统铺平了道路,通过减少传感器套件来实现。 为了验证这一分析结果,本研究考虑了仅作用于无人机上的干扰情况,并开发了一种复合扰动滤波方案。设计基于扰动观测器的误差状态扩展卡尔曼滤波器用于同时进行状态和扰动估计,在流形 $(\mathbb{R}^3)^2\times(TS^2)^3$ 上实现了系统整体估计性能的提升。 我们的仿真和实验测试验证了仅使用无人机里程计信息即可完全估计系统的状态与干扰。
https://arxiv.org/abs/2512.09377
This paper focuses on the key issue in autonomous driving: small target recognition in dynamic perception. Existing algorithms suffer from poor detection performance due to missing small target information, scale imbalance, and occlusion. We propose an improved YOLOv8n-SPTS model, which enhances the detection accuracy of small traffic targets through three key innovations: First, optimizing the feature extraction module. In the Backbone Bottleneck structure of YOLOv8n, 4 traditional convolution modules are replaced with Space-to-Depth Convolution (SPD-Conv) modules. This module retains fine-grained information through space-to-depth conversion, reduces information loss, and enhances the ability to capture features of low-resolution small targets. Second, enhancing feature fusion capability. The Spatial Pyramid Pooling - Fast Cross Stage Partial Connection (SPPFCSPC) module is introduced to replace the original SPPF module, integrating the multi-scale feature extraction from Spatial Pyramid Pooling (SPP) and the feature fusion mechanism of Cross Stage Partial Connection (CSP), thereby improving the model's contextual understanding of complex scenes and multi-scale feature expression ability. Third, designing a dedicated detection structure for small targets. A Triple-Stage Feature Pyramid (TSFP) structure is proposed, which adds a 160*160 small target detection head to the original detection heads to fully utilize high-resolution features in shallow layers; meanwhile, redundant large target detection heads are removed to balance computational efficiency. Comparative experiments on the VisDrone2019-DET dataset show that YOLOv8n-SPTS model ranks first in precision (61.9%), recall (48.3%), mAP@0.5 (52.6%), and mAP@0.5:0.95 (32.6%). Visualization results verify that the miss rate of small targets such as pedestrians and bicycles in occluded and dense scenes is significantly reduced.
这篇论文聚焦于自主驾驶中的关键问题:动态感知中小目标的识别。现有的算法由于缺少小目标信息、尺度不平衡以及遮挡等因素,导致检测性能不佳。我们提出了一种改进的YOLOv8n-SPTS模型,通过三项关键创新提高了对小型交通目标的检测准确性: 第一,优化特征提取模块。在YOLOv8n的Backbone Bottleneck结构中,用Space-to-Depth Convolution(SPD-Conv)模块替换了4个传统的卷积模块。这个模块通过空间到深度的转换保留了细粒度信息,减少了信息损失,并增强了对低分辨率小目标特征捕捉的能力。 第二,增强特性融合能力。引入Spatial Pyramid Pooling - Fast Cross Stage Partial Connection (SPPFCSPC)模块替代原始的SPPF模块,结合多尺度特性的空间金字塔池化(Spatial Pyramid Pooling, SPP)以及跨阶段部分连接(Cross Stage Partial Connection, CSP)的特征融合机制,从而提高了模型对复杂场景和多尺度特性表达的能力。 第三,设计了专门针对小目标检测的结构。提出Triple-Stage Feature Pyramid (TSFP)结构,在原有检测头部的基础上增加了一个160*160的小目标检测头,充分利用浅层中的高分辨率特征;同时删除冗余的大目标检测头部以平衡计算效率。 在VisDrone2019-DET数据集上的比较实验表明,YOLOv8n-SPTS模型在精度(61.9%)、召回率(48.3%)、mAP@0.5(52.6%)和mAP@0.5:0.95(32.6%)方面排名首位。可视化结果显示,在遮挡严重或密度高的场景中,行人和自行车等小目标的漏检率显著降低。
https://arxiv.org/abs/2512.09296
Multi-Agent Reinforcement Learning (MARL) is commonly deployed in settings where agents are trained via self-play with homogeneous teammates, often using parameter sharing and a single policy architecture. This opens the question: to what extent do self-play PPO agents learn general coordination strategies grounded in the underlying game, compared to overfitting to their training partners' behaviors? This paper investigates the question using the Heterogeneous Multi-Agent Challenge (HeMAC) environment, which features distinct Observer and Drone agents with complementary capabilities. We introduce Rotating Policy Training (RPT), an approach that rotates heterogeneous teammate policies of different learning algorithms during training, to expose the agent to a broader range of partner strategies. When playing alongside a withheld teammate policy (DDQN), we find that RPT achieves similar performance to a standard self-play baseline, IPPO, where all agents were trained sharing a single PPO policy. This result indicates that in this heterogeneous multi-agent setting, the IPPO baseline generalizes to novel teammate algorithms despite not experiencing teammate diversity during training. This shows that a simple IPPO baseline may possess the level of generalization to novel teammates that a diverse training regimen was designed to achieve.
多智能体强化学习(MARL)通常在同质队友之间通过自博弈训练代理的环境中部署,常常使用参数共享和单一策略架构。这引发了一个问题:自我对局中的PPO智能体所学到的一般协调策略,在多大程度上基于底层游戏,而非过度拟合于其训练伙伴的行为?本文利用异构多智能体挑战(HeMAC)环境来研究这个问题,该环境中具有不同的观察者和无人机代理,它们具备互补的能力。我们引入了旋转策略培训(RPT),一种在训练期间交换不同学习算法的异构队友策略的方法,以使智能体接触更广泛的合作策略范围。当与一个被保留下来的队友策略(DDQN)一起游戏时,我们发现RPT达到了类似性能的标准自博弈基线IPPO的水平,在该基线下所有代理都是通过共享单一PPO策略进行训练的。这一结果表明,在这种异构多智能体设置中,即使没有经历队友多样性的训练,基于IPPO的基准也能推广到新颖的算法伙伴上。这显示了一个简单的IPPO基线可能具有实现多样化训练方案所设计的新颖队友泛化水平的能力。
https://arxiv.org/abs/2512.08877
This paper addresses the problem of trajectory planning for information gathering with a dynamic and resolution-varying sensor footprint. Ergodic planning offers a principled framework that balances exploration (visiting all areas) and exploitation (focusing on high-information regions) by planning trajectories such that the time spent in a region is proportional to the amount of information in that region. Existing ergodic planning often oversimplifies the sensing model by assuming a point sensor or a footprint with constant shape and resolution. In practice, the sensor footprint can drastically change over time as the robot moves, such as aerial robots equipped with downward-facing cameras, whose field of view depends on the orientation and altitude. To overcome this limitation, we propose a new metric that accounts for dynamic sensor footprints, analyze the theoretic local optimality conditions, and propose numerical trajectory optimization algorithms. Experimental results show that the proposed approach can simultaneously optimize both the trajectories and sensor footprints, with up to an order of magnitude better ergodicity than conventional methods. We also deploy our approach in a multi-drone system to ergodically cover an object in 3D space.
本文探讨了使用动态且分辨率可变的传感器足印进行信息收集轨迹规划的问题。遍历性规划提供了一个原则性的框架,通过计划使机器人在某一区域停留的时间与其所含信息量成正比的方式,在探索(访问所有区域)和利用(聚焦于高信息密度区域)之间寻求平衡。然而,现有的遍历性规划通常过于简化了传感模型,假设为点传感器或具有固定形状与分辨率的足印。实际上,随着机器人的移动,其传感器足印可能会随时间发生显著变化,例如装备有向下朝向相机的空中机器人,其视野取决于姿态和高度。 为了克服这一限制,我们提出了一种新的度量标准来考虑动态传感器足印,并分析了理论上的局部最优性条件。同时,我们也提出了数值轨迹优化算法。实验结果表明,所提出的方案可以同时优化轨迹与传感器足印,相比于传统方法,遍历性提高了至少一个数量级。此外,我们在一个多无人机系统中部署了该方案,以在三维空间内对物体进行遍历覆盖。
https://arxiv.org/abs/2512.08661
This paper investigates the use of Multi-Task Bayesian Optimization for tuning decentralized trajectory generation algorithms in multi-drone systems. We treat each task as a trajectory generation scenario defined by a specific number of drone-to-drone interactions. To model relationships across scenarios, we employ Multi-Task Gaussian Processes, which capture shared structure across tasks and enable efficient information transfer during optimization. We compare two strategies: optimizing the average mission time across all tasks and optimizing each task individually. Through a comprehensive simulation campaign, we show that single-task optimization leads to progressively shorter mission times as swarm size grows, but requires significantly more optimization time than the average-task approach.
本文研究了多任务贝叶斯优化在调整多无人机系统中分散轨迹生成算法参数方面的应用。我们将每个任务视为由特定数量的无人机间交互定义的轨迹生成场景。为了建模不同场景之间的关系,我们采用多任务高斯过程,该方法可以捕捉跨任务共享的结构,并且能够实现在优化过程中有效信息传递。我们比较了两种策略:一种是在所有任务上平均优化使命时间;另一种是单独为每个任务进行优化。通过全面的模拟实验,我们展示了单任务优化会导致随着群组规模增大而使命时间逐渐缩短,但这种方法比平均任务方法需要更多的优化时间。
https://arxiv.org/abs/2512.08630
This paper presents an aerially deployable crawler designed for adaptive locomotion and manipulation within tree canopies. The system combines compliant microspine-based tracks, a dual-track rotary gripper, and an elastic tail, enabling secure attachment and stable traversal across branches of varying curvature and inclination. Experiments demonstrate reliable gripping up to 90 degrees of body roll and inclination, while effective climbing on branches inclined up to 67.5 degrees, achieving a maximum speed of 0.55 body lengths per second on horizontal branches. The compliant tracks allow yaw steering of up to 10 degrees, enhancing maneuverability on irregular surfaces. Power measurements show efficient operation with a dimensionless cost of transport over an order of magnitude lower than typical hovering power consumption in aerial robots. Integrated within a drone-tether deployment system, the crawler provides a robust, low-power platform for environmental sampling and in-canopy sensing, bridging the gap between aerial and surface-based ecological robotics.
这篇论文介绍了一种可空中部署的爬行器,该设备专门用于树冠内的适应性运动和操作。系统结合了柔性的微脊带、双轨旋转夹持器以及弹性尾巴,使它能够在不同曲率和倾斜度的树枝上安全附着并稳定行走。实验表明,该装置能够可靠地在最大90度身体翻滚和倾斜角度下抓握,并且在倾斜至67.5度的树干上有效攀爬,在水平树干上的最高速度可达每秒0.55个自身长度。柔性的轨道允许最多10度的偏航转向,提高了在不规则表面操作时的机动性。功率测量显示其运行效率很高,非尺寸化的运输成本比空中机器人典型悬停功率消耗低一个数量级。集成到无人机系留部署系统中后,该爬行器为环境采样和树冠内传感提供了一个强大的、低能耗平台,填补了空基与地面生态机器人之间的空白。
https://arxiv.org/abs/2512.07680
This paper investigates and develops methods for detecting small objects in large-scale aerial images. Current approaches for detecting small objects in aerial images often involve image cropping and modifications to detector network architectures. Techniques such as sliding window cropping and architectural enhancements, including higher-resolution feature maps and attention mechanisms, are commonly employed. Given the growing importance of aerial imagery in various critical and industrial applications, the need for robust frameworks for small object detection becomes imperative. To address this need, we adopted the base SW-YOLO approach to enhance speed and accuracy in small object detection by refining cropping dimensions and overlap in sliding window usage and subsequently enhanced it through architectural modifications. we propose a novel model by modifying the base model architecture, including advanced feature extraction modules in the neck for feature map enhancement, integrating CBAM in the backbone to preserve spatial and channel information, and introducing a new head to boost small object detection accuracy. Finally, we compared our method with SAHI, one of the most powerful frameworks for processing large-scale images, and CZDet, which is also based on image cropping, achieving significant improvements in accuracy. The proposed model achieves significant accuracy gains on the VisDrone2019 dataset, outperforming baseline YOLOv5L detection by a substantial margin. Specifically, the final proposed model elevates the mAP .5.5 accuracy on the VisDrone2019 dataset from the base accuracy of 35.5 achieved by the YOLOv5L detector to 61.2. Notably, the accuracy of CZDet, which is another classic method applied to this dataset, is 58.36. This research demonstrates a significant improvement, achieving an increase in accuracy from 35.5 to 61.2.
本文研究并开发了在大规模航拍图像中检测小型物体的方法。目前,用于检测航拍图像中小型物体的常用方法通常包括裁剪图片和修改目标网络架构。常用的技巧包括滑动窗口裁剪以及通过提高分辨率特征图和注意力机制等手段改进网络结构。鉴于航拍影像在各种关键和工业应用中的重要性日益增加,开发稳健的小型物体检测框架变得越来越迫切。 为应对这一需求,我们采用了基础的SW-YOLO方法,并通过优化滑动窗口使用过程中的裁剪尺寸及重叠度来提升小型物体检测的速度与准确性。在此基础上,进一步通过对模型架构进行改进,包括在颈部模块中引入先进的特征提取机制以增强特征图、将CBAM集成到骨干网络中保存空间和通道信息以及添加新的头部模块提高小目标检测的准确率。 最后,我们将所提出的方法与其他方法进行了比较,其中包括处理大规模图像最强大的框架之一SAHI及同样基于图片裁剪的CZDet,并取得了显著的准确性提升。在VisDrone2019数据集上,本文提出的模型实现了重大的精度提升,超越了基准YOLOv5L检测器35.5的基础准确率,达到61.2的mAP .5精度。值得注意的是,同样应用于该数据集的经典方法CZDet的准确率为58.36。本研究证明,在从基础YOLOv5L探测器的35.5到最终模型的61.2这一显著准确性提升方面实现了重大改进。
https://arxiv.org/abs/2512.07379
Referring expression segmentation is a fundamental task in computer vision that integrates natural language understanding with precise visual localization of target regions. Considering aerial imagery (e.g., modern aerial photos collected through drones, historical photos from aerial archives, high-resolution satellite imagery, etc.) presents unique challenges because spatial resolution varies widely across datasets, the use of color is not consistent, targets often shrink to only a few pixels, and scenes contain very high object densities and objects with partial occlusions. This work presents Aerial-D, a new large-scale referring expression segmentation dataset for aerial imagery, comprising 37,288 images with 1,522,523 referring expressions that cover 259,709 annotated targets, spanning across individual object instances, groups of instances, and semantic regions covering 21 distinct classes that range from vehicles and infrastructure to land coverage types. The dataset was constructed through a fully automatic pipeline that combines systematic rule-based expression generation with a Large Language Model (LLM) enhancement procedure that enriched both the linguistic variety and the focus on visual details within the referring expressions. Filters were additionally used to simulate historic imaging conditions for each scene. We adopted the RSRefSeg architecture, and trained models on Aerial-D together with prior aerial datasets, yielding unified instance and semantic segmentation from text for both modern and historical images. Results show that the combined training achieves competitive performance on contemporary benchmarks, while maintaining strong accuracy under monochrome, sepia, and grainy degradations that appear in archival aerial photography. The dataset, trained models, and complete software pipeline are publicly available at this https URL .
参考表达分割是计算机视觉中的一个基础任务,它将自然语言理解与目标区域的精确视觉定位相结合。考虑到空中图像(例如通过无人机收集的现代航拍照片、历史档案中的照片、高分辨率卫星图像等)带来了独特的挑战,因为这些数据集的空间分辨率变化很大,颜色使用不一致,目标通常缩小到只有几个像素,并且场景包含非常高的物体密度和部分遮挡的物体。这项工作介绍了一个新的大规模参考表达分割数据集Aerial-D,该数据集专门针对空中图像设计,包括37,288张图片、1,522,523个参考表达式,这些表达覆盖了259,709个标注的目标,涵盖单个对象实例、一组实例以及21种不同的语义区域类别,从车辆和基础设施到土地覆盖类型。该数据集是通过一个全自动流程构建的,结合系统规则生成参考表达,并使用大型语言模型(LLM)增强程序来丰富参考表达的语言多样性并强调视觉细节中的关注点。此外还采用了过滤器模拟每个场景的历史成像条件。 我们采用RSRefSeg架构,在Aerial-D和先前的空中图像数据集上联合训练了模型,从而为现代和历史图像从文本中实现了统一的对象实例和语义分割。结果表明,组合训练在当代基准测试中取得了具有竞争力的表现,并且在黑白、棕褐色和颗粒状退化等历史航空摄影中的图像条件下仍保持了强大的准确性。该数据集、经过训练的模型以及完整的软件流程均可通过此链接公开获取:[在此插入实际URL]。
https://arxiv.org/abs/2512.07338
Flight control software is typically designed with numerous configurable parameters governing multiple functionalities, enabling flexible adaptation to mission diversity and environmental uncertainty. Although developers and manufacturers usually provide recommendations for these parameters to ensure safe and stable operations, certain combinations of parameters with recommended values may still lead to unstable flight behaviors, thereby degrading the drone's robustness. To this end, we propose a Large Language Model (LLM) based approach for real-time repair of risk-prone configurations (named RisConFix) that degrade drone robustness. RisConFix continuously monitors the drone's operational state and automatically triggers a repair mechanism once abnormal flight behaviors are detected. The repair mechanism leverages an LLM to analyze relationships between configuration parameters and flight states, and then generates corrective parameter updates to restore flight stability. To ensure the validity of the updated configuration, RisConFix operates as an iterative process; it continuously monitors the drone's flight state and, if an anomaly persists after applying an update, automatically triggers the next repair cycle. We evaluated RisConFix through a case study of ArduPilot (with 1,421 groups of misconfigurations). Experimental results show that RisConFix achieved a best repair success rate of 97% and an optimal average number of repairs of 1.17, demonstrating its capability to effectively and efficiently repair risk-prone configurations in real time.
飞行控制软件通常设计有许多可配置参数,这些参数管理着多种功能,使无人机能够灵活适应任务多样性和环境不确定性。尽管开发者和制造商一般会为这些参数提供推荐值以确保安全稳定的运行,但某些使用推荐值的参数组合仍可能导致不稳定飞行行为,从而降低无人机的鲁棒性。 为此,我们提出了一种基于大型语言模型(LLM)的方法来实时修复损害无人机稳定性的高风险配置问题(命名为RisConFix)。该方法持续监控无人机的操作状态,并在检测到异常飞行行为时自动触发修复机制。修复机制利用LLM分析配置参数与飞行状态之间的关系,然后生成校正的参数更新以恢复飞行稳定性。为了确保更新后的配置的有效性,RisConFix采用迭代方式运行;它会不断监测无人机的飞行状态,在应用一次修正后仍存在异常的情况下自动触发下一个修复周期。 我们通过ArduPilot(包含1,421组误配置)的一个案例研究对RisConFix进行了评估。实验结果显示,RisConFix实现了最高97%的成功修复率和最优平均每次修复次数为1.17次,证明了它能够有效地在实时环境中修复高风险配置问题。
https://arxiv.org/abs/2512.07122
Detecting small objects in UAV remote sensing images and identifying surface defects in industrial inspection remain difficult tasks. These applications face common obstacles: features are sparse and weak, backgrounds are cluttered, and object scales vary dramatically. Current transformer-based detectors, while powerful, struggle with three critical issues. First, features degrade severely as networks downsample progressively. Second, spatial convolutions cannot capture long-range dependencies effectively. Third, standard upsampling methods inflate feature maps unnecessarily. We introduce DFIR-DETR to tackle these problems through dynamic feature aggregation combined with frequency-domain processing. Our architecture builds on three novel components. The DCFA module uses dynamic K-sparse attention, cutting complexity from O(N2) down to O(NK), and employs spatial gated linear units for better nonlinear modeling. The DFPN module applies amplitude-normalized upsampling to prevent feature inflation and uses dual-path shuffle convolution to retain spatial details across scales. The FIRC3 module operates in the frequency domain, achieving global receptive fields without sacrificing efficiency. We tested our method extensively on NEU-DET and VisDrone datasets. Results show mAP50 scores of 92.9% and 51.6% respectively-both state-of-the-art. The model stays lightweight with just 11.7M parameters and 41.2 GFLOPs. Strong performance across two very different domains confirms that DFIR-DETR generalizes well and works effectively in resource-limited settings for cross-scene small object detection.
在无人机遥感图像中检测小型物体以及在工业检查中识别表面缺陷仍然是具有挑战性的任务。这些应用面临一些共同的障碍:特征稀疏且微弱、背景复杂,以及目标尺度变化巨大。尽管基于变压器的探测器已经非常强大,但它们仍然面临着三个关键问题。首先,随着网络逐步下采样,特征会严重退化。其次,空间卷积无法有效捕捉长距离依赖关系。第三,标准上采样方法会导致特征图不必要的膨胀。为此,我们提出了DFIR-DETR(动态特征聚合与频域处理结合的方法),旨在通过引入三个新颖的组件来解决这些问题。 1. **DCFA模块**:该模块采用动态K稀疏注意力机制,将复杂度从O(N^2)降低到O(NK),并利用空间门控线性单元进行更好的非线性建模。 2. **DFPN模块**:此模块应用幅度归一化上采样以防止特征膨胀,并使用双路径混洗卷积来跨尺度保留空间细节。 3. **FIRC3模块**:该模块在频域中操作,实现了全局感受野而不牺牲效率。 我们在NEU-DET和VisDrone数据集上对方法进行了广泛的测试。实验结果表明,在这两个数据集中分别取得了92.9%和51.6%的mAP50分数——两者均为行业领先水平。模型保持轻量级,仅包含11.7M参数和41.2 GFLOPs。在两个非常不同的领域中表现出色,证明了DFIR-DETR具有良好的泛化能力,并且适用于资源受限环境中的跨场景小型物体检测任务。
https://arxiv.org/abs/2512.07078
Manual pruning of radiata pine trees poses significant safety risks due to extreme working heights and challenging terrain. This paper presents a computer vision framework that integrates YOLO object detection with Semi-Global Block Matching (SGBM) stereo vision for autonomous drone-based pruning operations. Our system achieves precise branch detection and depth estimation using only stereo camera input, eliminating the need for expensive LiDAR sensors. Experimental evaluation demonstrates YOLO's superior performance over Mask R-CNN, achieving 82.0% mAPmask50-95 for branch segmentation. The integrated system accurately localizes branches within a 2 m operational range, with processing times under one second per frame. These results establish the feasibility of cost-effective autonomous pruning systems that enhance worker safety and operational efficiency in commercial forestry.
手动修剪辐射松树由于极端的工作高度和复杂的地形,存在显著的安全风险。本文提出了一种计算机视觉框架,该框架结合了YOLO目标检测技术和半全局块匹配(SGBM)立体视觉技术,用于基于自主无人机的修剪作业。我们的系统仅通过使用双目摄像头输入实现了精确的枝条检测和深度估计,从而无需昂贵的激光雷达传感器。 实验评估表明,在枝条分割方面,YOLO的表现优于Mask R-CNN,达到82.0% mAPmask50-95。集成系统能够在一个2米的操作范围内准确定位枝条,并且处理时间每帧不到一秒。这些结果证明了低成本自主修剪系统的可行性,该系统可以提高工人的安全性和商业林业的运营效率。
https://arxiv.org/abs/2512.05412
Real-time tracking of small unmanned aerial vehicles (UAVs) on edge devices faces a fundamental resolution-speed conflict. Downsampling high-resolution imagery to standard detector input sizes causes small target features to collapse below detectable thresholds. Yet processing native 1080p frames on resource-constrained platforms yields insufficient throughput for smooth gimbal control. We propose SDG-Track, a Sparse Detection-Guided Tracker that adopts an Observer-Follower architecture to reconcile this conflict. The Observer stream runs a high-capacity detector at low frequency on the GPU to provide accurate position anchors from 1920x1080 frames. The Follower stream performs high-frequency trajectory interpolation via ROI-constrained sparse optical flow on the CPU. To handle tracking failures from occlusion or model drift caused by spectrally similar distractors, we introduce Dual-Space Recovery, a training-free re-acquisition mechanism combining color histogram matching with geometric consistency constraints. Experiments on a ground-to-air tracking station demonstrate that SDG-Track achieves 35.1 FPS system throughput while retaining 97.2\% of the frame-by-frame detection precision. The system successfully tracks agile FPV drones under real-world operational conditions on an NVIDIA Jetson Orin Nano. Our paper code is publicly available at this https URL
实时在边缘设备上追踪小型无人驾驶飞行器(UAV)面临着基本的分辨率-速度冲突。将高分辨率图像降采样至标准检测模型输入尺寸会导致小目标特征消失到不可检出阈值以下。然而,在资源受限平台上处理原始1080p帧无法达到平稳云台控制所需的足够吞吐量。为此,我们提出了SDG-Track,即稀疏检测引导追踪器,采用观察者-跟随者架构来解决这一冲突。观察者流在GPU上以低频运行高容量检测器,从1920x1080帧中提供准确的位置锚点。跟随者流则通过CPU上的感兴趣区域(ROI)约束稀疏光流,在高频下进行轨迹插值。 为了处理由遮挡或与目标具有相似光谱特性的干扰物导致的追踪失败,我们引入了双空间恢复机制——这是一种无需训练的重新获取手段,结合颜色直方图匹配和几何一致性约束。在地面至空中跟踪站上的实验表明,SDG-Track能够在保持97.2%的帧间检测精度的同时实现35.1 FPS的系统吞吐量。该系统成功地在现实世界操作条件下,在NVIDIA Jetson Orin Nano上追踪敏捷的第一人称视角(FPV)无人机。 我们的研究代码可公开获取,详情请访问:[提供的链接] (请将 [提供的链接] 替换为实际的网址)
https://arxiv.org/abs/2512.04883
Drones are becoming indispensable in many application domains. In data-driven missions, besides sensing, the drone must process the collected data at runtime to decide whether additional action must be taken on the spot, before moving to the next point of interest. If processing does not reveal an event or situation that requires such an action, the drone has waited in vain instead of moving to the next point. If, however, the drone starts moving to the next point and it turns out that a follow-up action is needed at the previous point, it must spend time to fly-back. To take this decision, we propose different machine-learning methods based on branch prediction and reinforcement learning. We evaluate these methods for a wide range of scenarios where the probability of event occurrence changes with time. Our results show that the proposed methods consistently outperform the regression-based method proposed in the literature and can significantly improve the worst-case mission time by up to 4.1x. Also, the achieved median mission time is very close, merely up to 2.7% higher, to that of a method with perfect knowledge of the current underlying event probability at each point of interest.
无人机在许多应用领域中变得不可或缺。在数据驱动的任务中,除了收集传感器数据外,无人机还必须在运行时处理这些数据以决定是否需要在现场采取进一步行动,然后再前往下一个兴趣点。如果处理结果没有发现需要此类操作的事件或情况,则无人机本可以继续前往下一个兴趣点,却在此处浪费了时间等待。然而,若无人机开始前往下一个兴趣点后才发现需要返回上一个兴趣点进行后续操作,则必须花费更多的时间飞回原地。 为了做出这种决策,我们提出了基于分支预测和强化学习的多种机器学习方法,并在一系列广泛场景中对其进行了评估——这些场景中的事件发生概率会随时间发生变化。我们的研究结果表明,所提出的方法在各种情况下始终优于文献中提出的回归法,并且可以显著减少最糟糕的任务执行时间(最多提高4.1倍)。此外,达成的中位任务执行时间也非常接近于一种假想情况下的方法——即无人机能够在每个兴趣点都准确知道当前事件发生的概率。
https://arxiv.org/abs/2512.04773