Abstract
We aim to use virtual reality (VR) to improve the spatial awareness of pilots by real-time scanning of the environment around the drone using onboard sensors, live streaming of this environment to a VR headset, and rendering a virtual representation of the drone and its environment for the pilot. This way, the pilot can see the immediate environment of the drone up close from a third-person perspective, as opposed to the first-person perspective that most drone cameras provide. This provides much more information about the drone surroundings for the pilot while operating the drone than existing teleoperation solutions. Previous solutions using VR have relied upon pre-made designs of the environment, which makes it difficult to adapt to changing environments. Our solution, in contrast, scans the environment as you fly, making it much more flexible for use in unknown environments.
Abstract (translated)
我们的目标是利用虚拟现实(VR)技术,通过无人机上的传感器实时扫描周围环境,并将这些信息流传输到VR头显中,从而提高飞行员的空间感知能力。此外,我们还会渲染一个虚拟的无人机及其环境的表示图给飞行员。这样一来,飞行员可以从第三人称视角近距离观察无人机周围的即时环境,而不仅仅是像大多数无人机摄像头提供的第一人称视角那样。这种方式为操作无人机时提供了比现有远程控制解决方案更多的关于无人机周围环境的信息。 以往采用VR技术的方法依赖于预先设计好的环境模型,这使得适应不断变化的环境变得困难。相比之下,我们的解决方案在飞行过程中实时扫描环境,使其更加灵活地适用于未知环境。
URL
https://arxiv.org/abs/2505.22599