Paper Reading AI Learner

Self-Supervised Learning to Fly using Efficient Semantic Segmentation and Metric Depth Estimation for Low-Cost Autonomous UAVs

2025-10-18 19:35:17
Sebastian Mocanu, Emil Slusanschi, Marius Leordeanu

Abstract

This paper presents a vision-only autonomous flight system for small UAVs operating in controlled indoor environments. The system combines semantic segmentation with monocular depth estimation to enable obstacle avoidance, scene exploration, and autonomous safe landing operations without requiring GPS or expensive sensors such as LiDAR. A key innovation is an adaptive scale factor algorithm that converts non-metric monocular depth predictions into accurate metric distance measurements by leveraging semantic ground plane detection and camera intrinsic parameters, achieving a mean distance error of 14.4 cm. The approach uses a knowledge distillation framework where a color-based Support Vector Machine (SVM) teacher generates training data for a lightweight U-Net student network (1.6M parameters) capable of real-time semantic segmentation. For more complex environments, the SVM teacher can be replaced with a state-of-the-art segmentation model. Testing was conducted in a controlled 5x4 meter laboratory environment with eight cardboard obstacles simulating urban structures. Extensive validation across 30 flight tests in a real-world environment and 100 flight tests in a digital-twin environment demonstrates that the combined segmentation and depth approach increases the distance traveled during surveillance and reduces mission time while maintaining 100% success rates. The system is further optimized through end-to-end learning, where a compact student neural network learns complete flight policies from demonstration data generated by our best-performing method, achieving an 87.5% autonomous mission success rate. This work advances practical vision-based drone navigation in structured environments, demonstrating solutions for metric depth estimation and computational efficiency challenges that enable deployment on resource-constrained platforms.

Abstract (translated)

这篇论文介绍了一种专为在受控室内环境中运行的小型无人机设计的仅基于视觉的自主飞行系统。该系统结合了语义分割和单目深度估计技术,以实现障碍物避障、场景探索以及无需GPS或昂贵传感器(如激光雷达)即可进行安全着陆操作的能力。关键创新之一是一种自适应比例因子算法,通过利用语义地面平面检测及相机的固有参数,将非度量单位的单目深度预测转换为准确的度量距离测量,实现了平均距离误差仅为14.4厘米的成绩。 该方法采用了一种知识蒸馏框架,其中基于颜色的支持向量机(SVM)教师模型生成训练数据,用于轻量级U-Net学生网络(拥有160万个参数),从而实现实时的语义分割。对于更复杂的环境,可以将SVM教师替换为最先进的分割模型。在受控5x4米实验室环境中进行了测试,该实验室设有模拟城市结构的八个纸板障碍物。 通过在真实世界环境下进行30次飞行试验和在数字孪生环境下进行100次飞行试验,验证了结合语义分割与深度估计的方法能够增加监视过程中无人机行驶的距离,并减少任务时间,同时保持百分之百的成功率。系统还通过端到端学习进一步优化,即紧凑的学生神经网络从我们最有效方法生成的演示数据中学习完整的飞行策略,实现了87.5%的自主任务成功率。 这项工作推进了结构化环境中基于视觉的无人机导航的实际应用,并展示了度量深度估计和计算效率挑战的解决方案,这使得部署在资源受限平台上成为可能。

URL

https://arxiv.org/abs/2510.16624

PDF

https://arxiv.org/pdf/2510.16624.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot