Abstract
Existing research on privacy-preserving Human Activity Recognition (HAR) typically evaluates methods against a binary paradigm: clear video versus a single privacy transformation. This limits cross-method comparability and obscures the nuanced relationship between privacy strength and recognition utility. We introduce \textit{PrivHAR-Bench}, a multi-tier benchmark dataset designed to standardize the evaluation of the \textit{Privacy-Utility Trade-off} in video-based action recognition. PrivHAR-Bench applies a graduated spectrum of visual privacy transformations: from lightweight spatial obfuscation to cryptographic block permutation, to a curated subset of 15 activity classes selected for human articulation diversity. Each of the 1,932 source videos is distributed across 9 parallel tiers of increasing privacy strength, with additional background-removed variants to isolate the contribution of human motion features from contextual scene bias. We provide lossless frame sequences, per-frame bounding boxes, estimated pose keypoints with joint-level confidence scores, standardized group-based train/test splits, and an evaluation toolkit computing recognition accuracy and privacy metrics. Empirical validation using R3D-18 demonstrates a measurable and interpretable degradation curve across tiers, with within-tier accuracy declining from 88.8\% (clear) to 53.5\% (encrypted, background-removed) and cross-domain accuracy collapsing to 4.8\%, establishing PrivHAR-Bench as a controlled benchmark for comparing privacy-preserving HAR methods under standardized conditions. The dataset, generation pipeline, and evaluation code are publicly available.
Abstract (translated)
现有关于隐私保护人类活动识别(HAR)的研究通常采用二元范式进行评估:清晰视频与单一隐私变换的对比。这限制了跨方法的可比性,并模糊了隐私强度与识别效用之间的细微关系。我们引入了\textit{PrivHAR-Bench},一个多层级基准数据集,旨在标准化基于视频的动作识别中\textit{隐私-效用权衡}的评估。PrivHAR-Bench应用了渐进的视觉隐私变换谱系:从轻量级空间模糊化到加密块置换,并针对人体动作多样性精心筛选了15个活动类别。每个1,932个源视频分布在9个隐私强度递增的平行层级中,并额外提供移除背景的变体,以隔离人体运动特征相对于场景上下文偏差的贡献。我们提供无损帧序列、每帧边界框、带关节置信度评分的估计姿态关键点、标准化的基于分组的训练/测试划分,以及计算识别准确率与隐私指标的评价工具包。使用R3D-18的实证验证表明,各层级间存在可测量且可解释的退化曲线,同层级准确率从88.8%(清晰)降至53.5%(加密、移除背景),跨域准确率则骤降至4.8%,确立了PrivHAR-Bench作为标准化条件下比较隐私保护HAR方法的可控基准。该数据集、生成流水线及评价代码已公开可用。
URL
https://arxiv.org/abs/2604.00761