Review of Multi-person Abnormal Behavior Detection Based on Deep Learning

doi:10.3778/j.issn.1673-9418.2504014

Abstract

Abstract: Content with the continuous advancement of deep learning technology, abnormal behavior detection has shifted from the traditional machine learning stage to the application of deep learning methods, and the research focus of abnormal behavior detection has shifted from single-person abnormal behavior to multi-person abnormal behavior. Multi-person abnormal behavior detection based on deep learning has become a research hotspot in the field of computer vision. For multi-person abnormal behavior detection, it is necessary to select appropriate feature extraction methods and abnormal behavior detection methods according to different scenarios. In order to make researchers have a clear and systematic understanding of the existing feature extraction methods based on deep learning and abnormal behavior detection methods in multi-person scenarios, this paper systematically analyzes and summarizes the feature extraction methods based on deep learning and multi-person abnormal behavior detection methods, and looks forward to the future development direction in view of the shortcomings of the existing methods. The definition, characteristics and classification of multi-person abnormal behavior are given. According to the feature extraction method based on deep learning and the multi-person abnormal behavior detection method based on deep learning, the existing multi-person abnormal behavior detection methods are sorted out and summarized. The commonly used public abnormal behavior detection data sets are introduced, and the performance of some models on common public data sets is compared. The future research directions in this field are prospected.

Key words: deep learning, feature extraction, abnormal behavior detection, multi-person anormal behavior, multimodal

摘要： 随着深度学习技术的不断进步，异常行为检测已经从传统的机器学习阶段转向为深度学习方法的应用，并且异常行为检测的研究焦点从单人异常行为转向多人异常行为。基于深度学习的多人异常行为检测已经成为计算机视觉领域的研究热点。对于多人异常行为检测来说，需要根据场景的不同选择合适的特征提取方法与异常行为检测方法。为了使研究者对现存的基于深度学习的特征提取方法和在多人场景下的异常行为检测方法有清晰而系统的了解，对基于深度学习的特征提取方法和多人异常行为检测方法进行系统的分析与总结，并针对现存方法的不足，对未来发展方向进行展望。给出多人异常行为的定义、特点及分类。以基于深度学习的特征提取方法与多人异常行为检测方法为线索，对现有的多人异常行为检测方法进行梳理和归纳。对常用的公共异常行为检测数据集进行介绍，并对部分模型在常用公共数据集上进行性能对比。对该领域未来的研究方向进行展望。

关键词: 深度学习, 特征提取, 异常行为检测, 多人异常行为, 多模态

WANG Yanjie, WANG Xiaoqiang, ZHAO Liurui, ZHUANG Xufei. Review of Multi-person Abnormal Behavior Detection Based on Deep Learning[J]. Journal of Frontiers of Computer Science and Technology, 2026, 20(2): 326-345.

王言杰, 王晓强, 赵刘锐, 庄旭菲. 基于深度学习的多人异常行为检测研究综述[J]. 计算机科学与探索, 2026, 20(2): 326-345.

References

[1] WU H, TANG X H, WANG Z Y, et al. Uncovering abnormal behavior patterns from mobility trajectories[J]. Sensors, 2021, 21(10): 3520.
[2] HAO Y X, TANG Z Y, ALZAHRANI B, et al. An end-to-end human abnormal behavior recognition framework for crowds with mentally disordered individuals[J]. IEEE Journal of Biomedical and Health Informatics, 2022, 26(8): 3618-3625.
[3] 付荣华.基于深度学习的视频异常行为检测算法研究[D]. 郑州: 郑州大学, 2022.
FU R H. Research on video abnormal behavior detection algorithm based on deep learning[D]. Zhengzhou: Zhengzhou University, 2022.
[4] LI Z W, ZHANG A Y, HAN F F, et al. Worker abnormal behavior recognition based on spatio-temporal graph convolution and attention model[J]. Electronics, 2023, 12(13): 2915.
[5] 王欢, 任明武, 杨静宇. 一种区域级运动目标检测方法[J]. 模式识别与人工智能, 2009, 22(5): 689-696.
WANG H, REN M W, YANG J Y. A region-level moving object detection method[J]. Pattern Recognition and Artificial Intelligence, 2009, 22(5): 689-696.
[6] THIDA M, ENG H L, REMAGNINO P. Laplacian eigenmap with temporal constraints for local abnormality detection in crowded scenes[J]. IEEE Transactions on Cybernetics, 2013, 43(6): 2147-2156.
[7] XU J X, DENMAN S, SRIDHARAN S, et al. An efficient and robust system for multiperson event detection in real-world indoor surveillance scenes[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2015, 25(6): 1063-1076.
[8] MOUSAVI H, GALOOGAHI H K, PERINA A, et al. Detecting abnormal behavioral patterns in crowd scenarios[M]//ESPOSITO A, JAIN L.Toward robotic socially believable behaving systems - volume II. Cham: Springer, 2016: 185-205.
[9] SHAO J, LOY C C, WANG X G. Scene-independent group profiling in crowd[C]//Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2014: 2227-2234.
[10] TAY N C, CONNIE T, ONG T S, et al. A review of abnormal behavior detection in activities of daily living[J]. IEEE Access, 2023, 11: 5069-5088.
[11] MOESLUND T B, HILTON A, KRüGER V. A survey of advances in vision-based human motion capture and analysis[J]. Computer Vision and Image Understanding, 2006, 104(2/3): 90-126.
[12] 刘邦义, 周激流, 张卫华. 一种时序边界注意力循环暴力行为检测神经网络[J]. 四川大学学报(自然科学版), 2023, 60(2): 106-114.
LIU B Y, ZHOU J L, ZHANG W H. Temporal edge attention recurrent neural network for violence detection[J]. Journal of Sichuan University (Natural Science Edition), 2023, 60(2): 106-114.
[13] 李金成, 闫睿骜, 代雪晶. 基于改进注意力机制与VGG-BiLSTM的暴力行为检测[J]. 现代电子技术, 2024, 47(21): 131-138.
LI J C, YAN R A, DAI X J. Violence behavior detection based on improved attention mechanism and VGG-BiLSTM[J]. Modern Electronics Technique, 2024, 47(21): 131-138.
[14] ANSARI M A, SINGH D K, SINGH V P. Detecting abnormal behavior in megastore for crime prevention using a deep neural architecture[J]. International Journal of Multimedia Information Retrieval, 2023, 12(2): 25.
[15] 陈承源, 邹顺水, 彭晨, 等. 面向边缘端的超市异常行为检测研究[J]. 工业控制计算机, 2024, 37(8): 120-122.
CHEN C Y, ZOU S S, PENG C, et al. Research on supermarket abnormal behavior detection for edge end[J]. Industrial Control Computer, 2024, 37(8): 120-122.
[16] LIU S D, WANG X Y, WANG L, et al. Abnormal behavior analysis strategy of bus drivers based on deep learning[C]//Proceedings of the 2021 IEEE 10th Data Driven Control and Learning Systems Conference. Piscataway: IEEE, 2021: 1522-1527.
[17] SONG H, KANG J, KIM T. Real-time abnormal behavior recognition for patient monitoring in hospitals[C]//Proceedings of the 2024 IEEE International Conference on Advanced Video and Signal Based Surveillance. Piscataway: IEEE, 2024: 1-8.
[18] MOHTAVIPOUR S M, SAEIDI M, ARABSORKHI A. A multi-stream CNN for deep violence detection in video sequences using handcrafted features[J]. The Visual Computer, 2022, 38(6): 2057-2072.
[19] ABIRAMI N, RADHIKA G, RADHIKA N. A comparative analysis on ATM theft detection based on human behaviour[C]//Proceedings of the 2025 International Conference on Computing, Circuits, Energy and Materials, 2025:020039.
[20] LIN H Y, TSENG C H. Abnormal activity detection and classification of bus passengers with in-vehicle image sensing[J]. IEEE Access, 2024, 12: 23057-23065.
[21] YE R, ZHANG K, ZHANG C, et al. Research on 3D convolutional autoencoder enhanced metro abnormal behavior detection based on multi-level attentional memory[J]. Multimedia Tools and Applications, 2025, 84(21): 23861-23879.
[22] MENG B, WANG F, PENG B, et al. Design and application of virtual simulation experiment of large-scale events security[C]//Proceedings of the 5th International Conference on Computer Science and Technologies in Education. Piscataway: IEEE, 2023: 232-236.
[23] WANG Y, LIU T Y, ZHOU J G, et al. Video anomaly detection based on spatio-temporal relationships among objects[J]. Neurocomputing, 2023, 532: 141-151.
[24] RENDóN-SEGADOR F J, áLVAREZ-GARCíA J A, SALAZAR-GONZáLEZ J L, et al. CrimeNet: neural structured learning using vision transformer for violence detection[J]. Neural Networks, 2023, 161: 318-329.
[25] SULLIVAN Y, DAVIS F. Self-regulation, mind wandering, and cognitive absorption during technology use[C]//Proceedings of the 53rd Hawaii International Conference on System Sciences, 2020: 4483-4492.
[26] KRIZHEVSKY A, SUTSKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks[C]//Advances in Neural Information Processing Systems 25, 2012: 1106-1114.
[27] SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[EB/OL]. [2025-02-05]. https://arxiv.org/abs/1409.1556.
[28] HE K M, ZHANG X Y, REN S Q, et al. Deep residual lear-ning for image recognition[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2016: 770-778.
[29] ALI GUL M, YOUSAF M H, NAWAZ S, et al. Patient monitoring by abnormal human activity recognition based on CNN architecture[J]. Electronics, 2020, 9(12): 1993.
[30] CHANG C W, CHANG C Y, LIN Y Y. A hybrid CNN and LSTM-based deep learning model for abnormal behavior detection[J]. Multimedia Tools and Applications, 2022, 81(9): 11825-11843.
[31] HU J, SHEN L, SUN G. Squeeze-and-excitation networks[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2018: 7132-7141.
[32] DOSOVITSKIY A, BEYER L, KOLESNIKOV A, et al. An image is worth 16x16 words: transformers for image recognition at scale[EB/OL]. [2025-02-05]. https://arxiv.org/abs/2010.11929.
[33] KUPPUSAMY P, BHARATHI V C. Human abnormal behavior detection using CNNs in crowded and uncrowded surveillance：a survey[J]. Measurement: Sensors, 2022, 24: 100510.
[34] HE K M, GKIOXARI G, DOLLáR P, et al. Mask R-CNN[C]//Proceedings of the 2017 IEEE International Conference on Computer Vision. Piscataway: IEEE, 2017: 2980-2988.
[35] REDMON J, FARHADI A. YOLOv3: an incremental improvement[EB/OL]. [2025-02-07]. https://arxiv.org/abs/1804. 02767.
[36] SU H, MAJI S, KALOGERAKIS E, et al. Multi-view convolutional neural networks for 3D shape recognition[C]//Proceedings of the 2015 IEEE International Conference on Computer Vision. Piscataway: IEEE, 2016: 945-953.
[37] KANEZAKI A, MATSUSHITA Y, NISHIDA Y. RotationNet: joint object categorization and pose estimation using multiviews from unsupervised viewpoints[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2018: 5010-5019.
[38] LIU Y F, XU X, LI S J, et al. Multi-view industrial anomaly detection with epipolar constrained cross-view fusion[EB/OL]. [2025-02-08]. https://arxiv.org/abs/2503.11088.
[39] WANG Y, SUN Y B, LIU Z W, et al. Dynamic graph CNN for learning on point clouds[J]. ACM Transactions on Graphics, 2019, 38(5): 1-12.
[40] ABUSHAM E A. Face verification using local graph stucture (LGS)[C]//Proceedings of the 2014 International Symposium on Biometrics and Security Technologies. Piscataway: IEEE, 2015: 79-83.
[41] WEI X, YU R X, SUN J. View-GCN: view-based graph convolutional network for 3D shape analysis[C]//Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2020: 1847-1856.
[42] HU T, HAN Z Z, ZWICKER M. 3D shape completion with multi-view consistent inference[C]//Proceedings of the 34th AAAI Conference on Artificial Intelligence. Palo Alto: AAAI, 2020: 10997-11004.
[43] JIN D W, HU Y Y, CHEN B H, et al. TIAN: a time series imaging association network for human abnormal behavior detection[J]. Information Fusion, 2025, 118: 102906.
[44] NGIAM J, KHOSLA A, KIM M, et al. Multimodal deep learning[C]//Proceedings of the 28th International Conference on Machine Learning, 2011: 689-696.
[45] WU Z R, SONG S R, KHOSLA A, et al. 3D ShapeNets: a deep representation for volumetric shapes[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2015: 1912-1920.
[46] VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]//Advances in Neural Information Processing Systems 30, 2017: 5998-6008.
[47] TRAN D, BOURDEV L, FERGUS R, et al. Learning spatiotemporal features with 3D convolutional networks[C]//Proceedings of the 2015 IEEE International Conference on Computer Vision. Piscataway: IEEE, 2016: 4489-4497.
[48] CARREIRA J, ZISSERMAN A. Quo vadis, action recognition? A new model and the kinetics dataset[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2017: 4724-4733.
[49] TAMMINA S. Transfer learning using VGG-16 with deep convolutional neural network for classifying images[J]. International Journal of Scientific and Research Publications, 2019, 9(10): 143-150.
[50] QIU Z F, YAO T, MEI T. Learning spatio-temporal representation with pseudo-3D residual networks[C]//Proceedings of the 2017 IEEE International Conference on Computer Vision. Piscataway: IEEE, 2017: 5534-5542.
[51] 肖进胜, 申梦瑶, 江明俊, 等. 融合包注意力机制的监控视频异常行为检测[J]. 自动化学报, 2022, 48(12): 2951-2959.
XIAO J S, SHEN M Y, JIANG M J, et al. Abnormal beha-vior detection algorithm with video-bag attention mechanism in surveillance video[J]. Acta Automatica Sinica, 2022, 48(12): 2951-2959.
[52] SIMONYAN K, ZISSERMAN A. Two-stream convolutional networks for action recognition in videos[C]//Advances in Neural Information Processing Systems 27, 2014: 568-576.
[53] TEED Z, DENG J. RAFT: recurrent all-pairs field transforms for optical flow[C]//Proceedings of the 16th European Conference on Computer Vision. Cham: Springer, 2020: 402-419.
[54] MEHMOOD A. Abnormal behavior detection in uncrowded videos with two-stream 3D convolutional neural networks[J]. Applied Sciences, 2021, 11(8): 3523.
[55] QIAN R, MENG T J, GONG B Q, et al. Spatiotemporal contrastive video representation learning[C]//Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2021: 6960-6970.
[56] CARREIRA J, NOLAND E, BANKI-HORVATH A, et al. A short note about kinetics-600[EB/OL]. [2025-02-10]. https://arxiv.org/abs/1808.01340.
[57] RADFORD A, KIM J W, HALLACY C, et al. Learning transferable visual models from natural language supervision[C]//Proceedings of the 38th International Conference on Machine Learning, 2021: 8748-8763.
[58] CHARLES R Q, HAO S, MO K C, et al. PointNet: deep learning on point sets for 3D classification and segmentation[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2017: 77-85.
[59] QI C R, YI L, SU H, et al. PointNet++: deep hierarchical feature learning on point sets in a metric space[C]//Advances in Neural Information Processing Systems 30, 2017: 5099-5108.
[60] LI Y Y, BU R, SUN M C, et al. PointCNN: convolution on X-transformed points[C]//Advances in Neural Information Processing Systems 31, 2018: 828-838.
[61] THOMAS H, QI C R, DESCHAUD J E, et al. KPConv: flexible and deformable convolution for point clouds[C]//Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE, 2019: 6410-6419.
[62] MATURANA D, SCHERER S. VoxNet: a 3D convolutional neural network for real-time object recognition[C]//Proceedings of the 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems. Piscataway: IEEE, 2015: 922-928.
[63] RIEGLER G, ULUSOY A O, GEIGER A. OctNet: learning deep 3D representations at high resolutions[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2017: 6620-6629.
[64] ?I?EK ?, ABDULKADIR A, LIENKAMP S S, et al. 3D U-Net: learning dense volumetric segmentation from sparse annotation[C]//Proceedings of the 19th International Conference on Medical Image Computing and Computer-Assisted Intervention. Cham: Springer, 2016: 424-432.
[65] DENG J J, SHI S S, LI P W, et al. Voxel R-CNN: towards high performance voxel-based 3D object detection[C]//Proceedings of the 35th AAAI Conference on Artificial Intelligence. Palo Alto: AAAI, 2021: 1201-1209.
[66] HANOCKA R, HERTZ A, FISH N, et al. MeshCNN: a network with an edge[J]. ACM Transactions on Graphics, 2019, 38(4): 1-12.
[67] WANG N Y, ZHANG Y D, LI Z W, et al. Pixel2Mesh: generating 3D mesh models from single RGB images[C]//Proceedings of the 15th European Conference on Computer Vision. Cham: Springer, 2018: 55-71.
[68] GKIOXARI G, JOHNSON J, MALIK J. Mesh R-CNN[C]//Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE, 2019: 9784-9794.
[69] LIU H D, KIM V G, CHAUDHURI S, et al. Neural subdivision[EB/OL]. [2025-02-23]. https://arxiv.org/abs/2005. 01819.
[70] LI X L, LIU Z N, CHEN T, et al. Mesh neural networks based on dual graph pyramids[J]. IEEE Transactions on Visualization and Computer Graphics, 2024, 30(7): 4211-4224.
[71] SABOKROU M, FATHY M, MOAYED Z, et al. Fast and accurate detection and localization of abnormal behavior in crowded scenes[J]. Machine Vision and Applications, 2017, 28(8): 965-985.
[72] MEHMOOD A. Efficient anomaly detection in crowd videos using pre-trained 2D convolutional neural networks[J]. IEEE Access, 2021, 9: 138283-138295.
[73] ZHOU J, HERENCSAR N. Abnormal behavior determination model of multimedia classroom students based on multi-task deep learning[J]. Mobile Networks and Applications, 2023, 28(3): 900-913.
[74] HE Y T, QIN Y F, CHEN L, et al. Efficient abnormal beha-vior detection with adaptive weight distribution[J]. Neurocomputing, 2024, 600: 128187.
[75] KUMAR M, PATEL A K, BISWAS M. Real-time detection of abnormal human activity using deep learning and temporal attention mechanism in video surveillance[J]. Multimedia Tools and Applications, 2024, 83(18): 55981-55997.
[76] WU Y K, QIU L H, WANG J M, et al. The use of convolutional neural networks for abnormal behavior recognition in crowd scenes[J]. Information Processing & Management, 2025, 62(1): 103880.
[77] FAN Z Y, YIN J Y, SONG Y, et al. Real-time and accurate abnormal behavior detection in videos[J]. Machine Vision and Applications, 2020, 31(7): 72.
[78] 宁冬梅, 梁莉. 结合模式记忆和自监督注意力的人群异常行为检测方法[J]. 计算机工程与设计, 2024, 45(8): 2527-2533.
NING D M, LIANG L. Method of crowd anomaly behavior detection combining pattern memory and self-supervised attention mechanism[J]. Computer Engineering and Design, 2024, 45(8): 2527-2533.
[79] DING C, LIU Q L, GUO X W, et al. Identifying unsafe beha-viors of construction workers through an unsupervised multi-anomaly GAN approach[J]. Automation in Construction, 2024, 165: 105509.
[80] 张红民, 庄旭, 郑敬添. 改进重建和预测网络的人体异常行为检测方法[J]. 计算机工程与应用, 2024, 60(17): 216-223.
ZHANG H M, ZHUANG X, ZHENG J T. Improve human abnormal behavior detection method of reconstruction and prediction network[J]. Computer Engineering and Applications, 2024, 60(17): 216-223.
[81] 张红民, 郑敬添, 颜鼎鼎, 等. 改进的生成对抗网络人体异常行为检测方法[J]. 计算机工程与应用, 2025, 61(5): 147-154.
ZHANG H M, ZHENG J T, YAN D D, et al. Improved detection method for human abnormal behavior in generative adversarial networks[J]. Computer Engineering and Applications, 2025, 61(5): 147-154.
[82] HE H S, LI Y, TAN J D. Relative motion estimation using visual-inertial optical flow[J]. Autonomous Robots, 2018, 42(3): 615-629.
[83] CHO S H, KANG H B. Abnormal behavior detection using hybrid agents in crowded scenes[J]. Pattern Recognition Letters, 2014, 44: 64-70.
[84] NAYAN N, SAHU S S, KUMAR S. Detecting anomalous crowd behavior using correlation analysis of optical flow[J]. Signal, Image and Video Processing, 2019, 13(6): 1233-1241.
[85] SONG L C, LIU B, ZHU H H, et al. Abnormal behavior detection based on target analysis[EB/OL]. [2025-02-25]. https://arxiv.org/abs/2107.13706.
[86] ZHANG J, WU C, WANG Y M, et al. Detection of abnormal behavior in narrow scene with perspective distortion[J]. Machine Vision and Applications, 2019, 30(5): 987-998.
[87] WU C F, CHENG Z X. A novel detection framework for detecting abnormal human behavior[J]. Mathematical Problems in Engineering, 2020: 6625695.
[88] ZHOU K, WU T T, WANG C Y, et al. Skeleton based abnormal behavior recognition using spatio-temporal convolution and attention-based LSTM[J]. Procedia Computer Science, 2020, 174: 424-432.
[89] CAO Z, HIDALGO G, SIMON T, et al. OpenPose: realtime multi-person 2D pose estimation using part affinity fields[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, 43(1): 172-186.
[90] LIU C M, FU R H, LI Y H, et al. A self-attention augmented graph convolutional clustering networks for skeleton-based video anomaly behavior detection[J]. Applied Sciences, 2021, 12(1): 4.
[91] DING Y R, BAO K, ZHANG J Z. An intelligent system for detecting abnormal behavior in students based on the human skeleton and deep learning[J]. Computational Intelligence and Neuroscience, 2022(1): 3819409.
[92] DONG X Q, WANG X C, LI B J, et al. MP-Abr: a framework for intelligent recognition of abnormal behaviour in multi-person scenarios[J]. Multimedia Tools and Applications, 2024, 83(18): 55605-55626.
[93] SONG J H, NANG J. Pedestrian abnormal behavior detection system using edge-server architecture for large-scale CCTV environments[J]. Applied Sciences, 2024, 14(11): 4615.
[94] FANG H S, LI J F, TANG H Y, et al. AlphaPose: whole-body regional multi-person pose estimation and tracking in real-time[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45(6): 7157-7173.
[95] WANG B. Research on the recognition of students?? abnormal classroom behaviors by new media robot in ideological and political education based on HRNet network[C]//Proceedings of the 2024 International Symposium on Intelligent Robotics and Systems. Piscataway: IEEE, 2024: 194-198.
[96] NAIMI S, BOUACHIR W, BILODEAU G A, et al. SSTAR: skeleton-based spatio-temporal action recognition for intelligent video surveillance and suicide prevention in metro stations[C]//Proceedings of the 2025 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops. Piscataway: IEEE, 2025: 765-775.
[97] NTALAMPIRAS S, GANCHEV T, POTAMITIS I, et al. Heterogeneous sensor database in support of human beha-viour analysis in unrestricted environments: the audio part[C]//Proceedings of the 7th International Conference on Language Resources and Evaluation, 2010.
[98] PAPINI M, IQBAL U, BARTHELEMY J, et al. The role of deep learning models in the detection of anti-social behaviours towards women in public transport from surveillance videos: a scoping review[J]. Safety, 2023, 9(4): 91.
[99] CAI C, JIN R N, NIE J T, et al. PURE: passive multi-person identification via footstep for mobile service networks[J]. IEEE Transactions on Vehicular Technology, 2023, 72(9): 12221-12233.
[100] QU Y Y, SHI L M, WANG X H, et al. Indoor multiperson detection and recognition through footsteps: a deep learning approach with acoustic signal analysis[J]. IEEE Sensors Journal, 2024, 24(12): 19482-19496.
[101] YIN J, YANG Q, PAN J J. Sensor-based abnormal human-activity detection[J]. IEEE Transactions on Knowledge and Data Engineering, 2008, 20(8): 1082-1090.
[102] ANDERSSON M, NTALAMPIRAS S, GANCHEV T, et al. Fusion of acoustic and optical sensor data for automatic fight detection in urban environments[C]//Proceedings of the 13th International Conference on Information Fusion. Piscataway: IEEE, 2011: 1-8.
[103] CIVITARESE G, BETTINI C. Monitoring objects manipulations to detect abnormal behaviors[C]//Proceedings of the 2017 IEEE International Conference on Pervasive Computing and Communications Workshops. Piscataway: IEEE, 2017: 388-393.
[104] LIU W Y, WANG S Y, WANG L. A multiperson behavior feature generation model based on noise reduction using WiFi[J]. IEEE Transactions on Industrial Electronics, 2020, 67(6): 5179-5186.
[105] KOOIJ J F P, LIEM M C, KRIJNDERS J D, et al. Multi-modal human aggression detection[J]. Computer Vision and Image Understanding, 2016, 144: 106-120.
[106] LI Y, ZHAI Q, DING S H, et al. Efficient health-related abnormal behavior detection with visual and inertial sensor integration[J]. Pattern Analysis and Applications, 2019, 22(2): 601-614.
[107] MIAO Y M, YANG J, ALZAHRANI B, et al. Abnormal behavior learning based on edge computing toward a crowd monitoring system[J]. IEEE Network, 2022, 36(3): 90-96.
[108] WANG Y B, WEN J H, ZHOU W, et al. Research on abnormal behavior prediction by integrating multiple indexes of student behavior and text information in big data environment[J]. Wireless Communications and Mobile Computing, 2022(1): 1902155.
[109] HE X N, CHUA T S. Neural factorization machines for sparse predictive analytics[C]//Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. New York: ACM, 2017: 355-364.
[110] CHEN W L, MA K T, JIAN YEW Z, et al. TEVAD: improved video anomaly detection with captions[C]//Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. Piscataway: IEEE, 2023: 5549-5559.
[111] LIU H C, MOHD KHAIRUDDIN A S, CHUAH J H, et al. Novel multimodal contrast learning framework using zero-shot prediction for abnormal behavior recognition[J]. Applied Intelligence, 2024, 55(2): 110.
[112] ZHU B, XIE Y, LUO G H, et al. An abnormal behavior detection method using optical flow model and OpenPose[J]. International Journal of Advanced Computer Science and Applications, 2020, 11(5): 28-34.
[113] ZENG X L, JIANG Y L, DING W R, et al. A hierarchical spatio-temporal graph convolutional neural network for anomaly detection in videos[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2023, 33(1): 200-212.
[114] HAMID A A, MONADJEMI S A, SHOUSHTARIAN B. ABDviaMSIFAT: abnormal crowd behavior detection utilizing a multi-source information fusion technique[J]. IEEE Access, 2025, 13: 75000-75019.
[115] SHE X Y, XU Z Q. Human abnormal behavior detection based on multimodal data fusion[C]//Proceedings of the 2024 International Conference on Data Science and Network Security. Piscataway: IEEE, 2024: 1-6.
[116] MAHADEVAN V, LI W X, BHALODIA V, et al. Anomaly detection in crowded scenes[C]//Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2010: 1975-1981.
[117] MEHRAN R, OYAMA A, SHAH M. Abnormal crowd behavior detection using social force model[C]//Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2009: 935-942.
[118] LU C W, SHI J P, JIA J Y. Abnormal event detection at 150 FPS in Matlab[C]//Proceedings of the 2013 IEEE International Conference on Computer Vision. Piscataway: IEEE, 2014: 2720-2727.
[119] LUO W X, LIU W, GAO S H. A revisit of sparse coding based anomaly detection in stacked RNN framework[C]//Proceedings of the 2017 IEEE International Conference on Computer Vision. Piscataway: IEEE, 2017: 341-349.
[120] FERRYMAN J, SHAHROKNI A. PETS2009: dataset and challenge[C]//Proceedings of the 2009 12th IEEE International Workshop on Performance Evaluation of Tracking and Surveillance. Piscataway: IEEE, 2010: 1-6.
[121] BHATNAGAR B L, XIE X H, PETROV I A, et al. BEHAVE: dataset and method for tracking human object interactions[C]//Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2022: 15914-15925.
[122] ACSINTOAE A, FLORESCU A, GEORGESCU M I, et al. UBnormal: new benchmark for supervised open-set video anomaly detection[C]//Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2022: 20111-20121.
[123] HASSNER T, ITCHER Y, KLIPER-GROSS O. Violent flows: real-time detection of violent crowd behavior[C]//Proceedings of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. Piscataway: IEEE, 2012: 1-6.
[124] CHENG M, CAI K J, LI M. RWF-2000: an open large scale video database for violence detection[C]//Proceedings of the 2020 25th International Conference on Pattern Recognition. Piscataway: IEEE, 2021: 4183-4190.
[125] BERMEJO NIEVAS E, DENIZ SUAREZ O, BUENO GARCíA G, et al. Violence detection in video using computer vision techniques[C]//Proceedings of the 14th International Conference on Computer Analysis of Images and Patterns. Berlin: Springer, 2011: 332-339.
[126] GEMMEKE J F, ELLIS D P W, FREEDMAN D, et al. Audio set: an ontology and human-labeled dataset for audio events[C]//Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing. Piscataway: IEEE, 2017: 776-780.