Abstract
Rapid naloxone delivery via drones offers a promising solution for responding to opioid overdose emergencies (OOEs), by extending lifesaving interventions to medically untrained bystanders before emergency medical services (EMS) arrive. Recognizing the critical role of bystander situational awareness (SA) in human-autonomy teaming (HAT), we address a key research gap in real-time SA assessment by introducing the Drone-Assisted Naloxone Delivery Simulation Dataset (DANDSD). This pioneering dataset captures HAT during simulated OOEs, where college students without medical training act as bystanders tasked with administering intranasal naloxone to a mock overdose victim. Leveraging this dataset, we propose a video-based real-time SA assessment framework that utilizes graph embeddings and transformer models to assess bystander SA in real time. Our approach integrates visual perception and comprehension cues--such as geometric, kinematic, and interaction graph features--and achieves high-performance SA prediction. It also demonstrates strong temporal segmentation accuracy, outperforming the FINCH baseline by 9% in Mean over Frames (MoF) and 5% in Intersection over Union (IoU). This work supports the development of adaptive drone systems capable of guiding bystanders effectively, ultimately improving emergency response outcomes and saving lives.
Abstract (translated)
通过无人机快速递送纳洛酮为应对阿片类药物过量紧急情况(OOEs)提供了一个有前景的解决方案,能够在紧急医疗服务到达之前将挽救生命的干预措施扩展到未接受医学培训的旁观者。鉴于情境意识(SA)在人-自主系统协作中的关键作用,我们通过引入无人机辅助纳洛酮递送模拟数据集(DANDSD),填补了实时SA评估这一重要研究空白。该开创性数据集记录了大学生志愿者在模拟OOEs中作为未接受医学训练的旁观者进行操作的情况,他们需要向假定的药物过量受害者施用鼻腔内纳洛酮。 利用这个数据集,我们提出了一种基于视频的实时SA评估框架,采用图嵌入和转换模型来评估旁观者的实时情境意识。我们的方法整合了视觉感知和理解线索——包括几何、运动和交互图形特征,并实现了高精度的情境意识预测。此外,它还展示了强大的时间分割准确度,在均帧(MoF)指标上比FINCH基线高出9%,在交并比(IoU)指标上高出5%。 这项工作支持开发能够有效引导旁观者适应的无人机系统,最终改善紧急响应结果,并挽救生命。
URL
https://arxiv.org/abs/2510.03558