Paper Reading AI Learner

VR-Based Control of Multi-Copter Operation

2025-05-28 17:14:30
Jack T. Hughes, Mohammad Ghufran, Hossein Rastgoftar

Abstract

We aim to use virtual reality (VR) to improve the spatial awareness of pilots by real-time scanning of the environment around the drone using onboard sensors, live streaming of this environment to a VR headset, and rendering a virtual representation of the drone and its environment for the pilot. This way, the pilot can see the immediate environment of the drone up close from a third-person perspective, as opposed to the first-person perspective that most drone cameras provide. This provides much more information about the drone surroundings for the pilot while operating the drone than existing teleoperation solutions. Previous solutions using VR have relied upon pre-made designs of the environment, which makes it difficult to adapt to changing environments. Our solution, in contrast, scans the environment as you fly, making it much more flexible for use in unknown environments.

Abstract (translated)

我们的目标是利用虚拟现实(VR)技术,通过无人机上的传感器实时扫描周围环境,并将这些信息流传输到VR头显中,从而提高飞行员的空间感知能力。此外,我们还会渲染一个虚拟的无人机及其环境的表示图给飞行员。这样一来,飞行员可以从第三人称视角近距离观察无人机周围的即时环境,而不仅仅是像大多数无人机摄像头提供的第一人称视角那样。这种方式为操作无人机时提供了比现有远程控制解决方案更多的关于无人机周围环境的信息。 以往采用VR技术的方法依赖于预先设计好的环境模型,这使得适应不断变化的环境变得困难。相比之下,我们的解决方案在飞行过程中实时扫描环境,使其更加灵活地适用于未知环境。

URL

https://arxiv.org/abs/2505.22599

PDF

https://arxiv.org/pdf/2505.22599.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot