Abstract
Deep learning-based gait recognition has achieved great success in various applications. The key to accurate gait recognition lies in considering the unique and diverse behavior patterns in different motion regions, especially when covariates affect visual appearance. However, existing methods typically use predefined regions for temporal modeling, with fixed or equivalent temporal scales assigned to different types of regions, which makes it difficult to model motion regions that change dynamically over time and adapt to their specific patterns. To tackle this problem, we introduce a Region-aware Dynamic Aggregation and Excitation framework (GaitRDAE) that automatically searches for motion regions, assigns adaptive temporal scales and applies corresponding attention. Specifically, the framework includes two core modules: the Region-aware Dynamic Aggregation (RDA) module, which dynamically searches the optimal temporal receptive field for each region, and the Region-aware Dynamic Excitation (RDE) module, which emphasizes the learning of motion regions containing more stable behavior patterns while suppressing attention to static regions that are more susceptible to covariates. Experimental results show that GaitRDAE achieves state-of-the-art performance on several benchmark datasets.
Abstract (translated)
基于深度学习的步态识别在各种应用中取得了巨大成功。准确进行步态识别的关键在于考虑不同运动区域的独特和多样化的行为模式,特别是在协变量影响视觉外观的情况下。然而,现有的方法通常使用预定义的区域来进行时间建模,并且给不同类型区域分配固定或等同的时间尺度,这使得难以对随时间动态变化的运动区域及其特定模式进行建模与适应。 为了解决这个问题,我们引入了一个基于区域感知的动态聚合和激励框架(GaitRDAE),该框架能够自动搜索运动区域、分配自适应的时间尺度并应用相应的注意力机制。具体来说,该框架包括两个核心模块:区域感知的动态聚合(RDA)模块,它为每个区域动态地寻找最优的时间感受野;以及区域感知的动态激励(RDE)模块,该模块强调学习包含更稳定行为模式的运动区域,并抑制对更容易受到协变量影响的静态区域的关注。 实验结果显示,GaitRDAE在几个基准数据集上达到了最先进的性能。
URL
https://arxiv.org/abs/2510.16541