Journal of Frontiers of Computer Science and Technology ›› 2020, Vol. 14 ›› Issue (9): 1580-1589.DOI: 10.3778/j.issn.1673-9418.1906054

Previous Articles     Next Articles

Double Residual Network Recognition Method for Falling Abnormal Behavior

WANG Xinwen, XIE Linbo, PENG Li   

  1. Engineering Research Center of Internet of Things Technology Applications (School of Internet of Things Engineering, Jiangnan University), Ministry of Education, Wuxi, Jiangsu 214122, China
  • Online:2020-09-01 Published:2020-09-07

跌倒异常行为的双重残差网络识别方法

王新文谢林柏彭力   

  1. 物联网技术应用教育部工程研究中心(江南大学 物联网工程学院),江苏 无锡 214122

Abstract:

In the abnormal behavior monitoring, due to the complicated situation such as monitoring angles of view, human body postures and scenes, it is easy to cause vanishing gradient and over-fitting by directly adding 3D con-volutional neural network layers to extract effective visual features, which reduces the action recognition rate. To solve these problems, this paper proposes a fall recognition method based on the double residual convolutional network. By nesting the residual network in the residual network, the double residual network fully integrates shallow and deep visual features and alleviates the impact of the vanishing gradient, and makes the performance of residual network improved. Finally, multiple cameras fall dataset (MCFD) and UR fall dataset (URFD) are tested and evaluated by the 5-fold cross-validation method. The results show that the performance is better than some fall recognition methods based on 3D convolutional network (C3D), 3D residual network (3D-Resnet), Pseudo-3D residual network (P3D), and (2+1)D residual network (R(2+1)D), which verifies the effectiveness of the double residual network model for improving the abnormal behavior recognition.

Key words: fall recognition, residual network, vanishing gradient, action recognition

摘要:

在异常行为监控中,由于监控视角、人体姿态和场景等复杂的情况,直接通过增加3D卷积神经网络层数来提取有效的视觉特征,容易导致卷积模型发生梯度消失和过拟合,从而降低了行为识别率。针对上述问题,提出了一种基于双重残差卷积网络的跌倒识别方法,通过在残差网络中嵌套残差网络,充分融合了浅层和深层视觉特征,缓解了模型训练时梯度消失问题带来的影响,从而使模型性能得到了提升。最后采用5折交叉验证方法在多相机跌倒数据集(MCFD)和热舒夫大学跌倒数据集(URFD)上进行了测试评估,结果表明双重残差网络性能优于三维卷积网络(C3D)、三维残差网络(3D-Resnet)、伪三维残差网络(P3D)和2+1维残差网络(R(2+1)D)识别方法,从而验证了双重残差网络模型对提高异常行为识别效果的有效性。

关键词: 跌倒识别, 残差网络, 梯度消失, 行为识别