Paper Reading AI Learner

Real-Time Assessment of Bystander Situation Awareness in Drone-Assisted First Aid

2025-10-03 23:11:30
Shen Chang, Renran Tian, Nicole Adams, Nan Kong

Abstract

Rapid naloxone delivery via drones offers a promising solution for responding to opioid overdose emergencies (OOEs), by extending lifesaving interventions to medically untrained bystanders before emergency medical services (EMS) arrive. Recognizing the critical role of bystander situational awareness (SA) in human-autonomy teaming (HAT), we address a key research gap in real-time SA assessment by introducing the Drone-Assisted Naloxone Delivery Simulation Dataset (DANDSD). This pioneering dataset captures HAT during simulated OOEs, where college students without medical training act as bystanders tasked with administering intranasal naloxone to a mock overdose victim. Leveraging this dataset, we propose a video-based real-time SA assessment framework that utilizes graph embeddings and transformer models to assess bystander SA in real time. Our approach integrates visual perception and comprehension cues--such as geometric, kinematic, and interaction graph features--and achieves high-performance SA prediction. It also demonstrates strong temporal segmentation accuracy, outperforming the FINCH baseline by 9% in Mean over Frames (MoF) and 5% in Intersection over Union (IoU). This work supports the development of adaptive drone systems capable of guiding bystanders effectively, ultimately improving emergency response outcomes and saving lives.

Abstract (translated)

通过无人机快速递送纳洛酮为应对阿片类药物过量紧急情况(OOEs)提供了一个有前景的解决方案,能够在紧急医疗服务到达之前将挽救生命的干预措施扩展到未接受医学培训的旁观者。鉴于情境意识(SA)在人-自主系统协作中的关键作用,我们通过引入无人机辅助纳洛酮递送模拟数据集(DANDSD),填补了实时SA评估这一重要研究空白。该开创性数据集记录了大学生志愿者在模拟OOEs中作为未接受医学训练的旁观者进行操作的情况,他们需要向假定的药物过量受害者施用鼻腔内纳洛酮。 利用这个数据集,我们提出了一种基于视频的实时SA评估框架,采用图嵌入和转换模型来评估旁观者的实时情境意识。我们的方法整合了视觉感知和理解线索——包括几何、运动和交互图形特征,并实现了高精度的情境意识预测。此外,它还展示了强大的时间分割准确度,在均帧(MoF)指标上比FINCH基线高出9%,在交并比(IoU)指标上高出5%。 这项工作支持开发能够有效引导旁观者适应的无人机系统,最终改善紧急响应结果,并挽救生命。

URL

https://arxiv.org/abs/2510.03558

PDF

https://arxiv.org/pdf/2510.03558.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot