Abstract
This paper presents a vision-only autonomous flight system for small UAVs operating in controlled indoor environments. The system combines semantic segmentation with monocular depth estimation to enable obstacle avoidance, scene exploration, and autonomous safe landing operations without requiring GPS or expensive sensors such as LiDAR. A key innovation is an adaptive scale factor algorithm that converts non-metric monocular depth predictions into accurate metric distance measurements by leveraging semantic ground plane detection and camera intrinsic parameters, achieving a mean distance error of 14.4 cm. The approach uses a knowledge distillation framework where a color-based Support Vector Machine (SVM) teacher generates training data for a lightweight U-Net student network (1.6M parameters) capable of real-time semantic segmentation. For more complex environments, the SVM teacher can be replaced with a state-of-the-art segmentation model. Testing was conducted in a controlled 5x4 meter laboratory environment with eight cardboard obstacles simulating urban structures. Extensive validation across 30 flight tests in a real-world environment and 100 flight tests in a digital-twin environment demonstrates that the combined segmentation and depth approach increases the distance traveled during surveillance and reduces mission time while maintaining 100% success rates. The system is further optimized through end-to-end learning, where a compact student neural network learns complete flight policies from demonstration data generated by our best-performing method, achieving an 87.5% autonomous mission success rate. This work advances practical vision-based drone navigation in structured environments, demonstrating solutions for metric depth estimation and computational efficiency challenges that enable deployment on resource-constrained platforms.
Abstract (translated)
这篇论文介绍了一种专为在受控室内环境中运行的小型无人机设计的仅基于视觉的自主飞行系统。该系统结合了语义分割和单目深度估计技术,以实现障碍物避障、场景探索以及无需GPS或昂贵传感器(如激光雷达)即可进行安全着陆操作的能力。关键创新之一是一种自适应比例因子算法,通过利用语义地面平面检测及相机的固有参数,将非度量单位的单目深度预测转换为准确的度量距离测量,实现了平均距离误差仅为14.4厘米的成绩。 该方法采用了一种知识蒸馏框架,其中基于颜色的支持向量机(SVM)教师模型生成训练数据,用于轻量级U-Net学生网络(拥有160万个参数),从而实现实时的语义分割。对于更复杂的环境,可以将SVM教师替换为最先进的分割模型。在受控5x4米实验室环境中进行了测试,该实验室设有模拟城市结构的八个纸板障碍物。 通过在真实世界环境下进行30次飞行试验和在数字孪生环境下进行100次飞行试验,验证了结合语义分割与深度估计的方法能够增加监视过程中无人机行驶的距离,并减少任务时间,同时保持百分之百的成功率。系统还通过端到端学习进一步优化,即紧凑的学生神经网络从我们最有效方法生成的演示数据中学习完整的飞行策略,实现了87.5%的自主任务成功率。 这项工作推进了结构化环境中基于视觉的无人机导航的实际应用,并展示了度量深度估计和计算效率挑战的解决方案,这使得部署在资源受限平台上成为可能。
URL
https://arxiv.org/abs/2510.16624