强化前景感知的相关滤波目标跟踪

doi:10.3778/j.issn.1673-9418.2207055

摘要/Abstract

摘要： 为了缓解相关滤波跟踪算法在形变、快速运动、运动模糊及相似物干扰等因素影响下跟踪精度较低的问题，提出了强化前景感知的相关滤波目标跟踪。在相关滤波算法的基础上引入了改进的颜色直方图干扰感知模型。首先，在传统背景对象模型基础上增强前景直方图与背景直方图的颜色差异分量，得到更加突出前景的颜色直方图干扰感知模型。利用相关滤波算法和颜色直方图干扰感知模型分别提取相应特征并计算各自响应。其次，通过利用颜色直方图干扰感知模型计算目标区域像素点属于目标的概率均值，控制相关滤波响应和颜色直方图响应的融合权重。然后，利用融合后的干扰感知响应图最大值位置定位目标。最后，设置跟踪异常判别条件，当异常情况出现，不进行模型更新。当跟踪置信度较高时，则通过帧差法和前后帧间欧氏距离判断目标变化幅度并设置相应的相关滤波模板更新学习率，实现跟踪模板的自适应更新。在OTB100数据集上与主流算法进行实验对比，结果表明该算法在形变、快速运动、运动模糊及相似物干扰等复杂挑战下相比其他算法具有更优的跟踪效果及鲁棒性。

Abstract: In order to alleviate the problem that the tracking accuracy of the correlation filtering target tracking algorithm is low due to the influence of deformation, fast motion, motion blur and similarity interference, this paper proposes the correlation filtering target tracking with enhanced foreground perception. An improved color histogram interference sensing model is introduced based on the correlation filtering algorithm. Firstly, based on the traditional background object model, the color difference component between foreground histogram and background histogram is enhanced to obtain a more prominent foreground color histogram interference sensing model. The correlation filter algorithm and the color histogram interference perception model are used to extract corresponding features and calculate their respective responses. Then the color histogram interference perception model is used to calculate the average probability that the pixels in the target area belong to the target. The average probability controls the fusion weights of correlation filter response and color histogram response. The maximum position of the fusion interference perception response graph is used to locate the target. Finally, the discriminant conditions of tracking anomalies are set. When abnormal conditions occur, no model update is carried out. When the tracking confidence is high, the range of target change is judged by frame difference method and Euclidean distance between two frames. The corresponding learning rate of correlation filtering template is set to realize the adaptive updating of tracking template. Experimental comparison with mainstream algorithms is conducted on OTB100 dataset, and the experimental results show that the proposed algorithm has better tracking performance and robustness than other algorithms under complex challenges such as deformation, fast motion, motion blur and similarity interference.

Key words: target tracking, correlation filtering, interference perception model, adaptive fusion, model update

姜文涛, 徐晓晴. 强化前景感知的相关滤波目标跟踪[J]. 计算机科学与探索, 2023, 17(10): 2462-2477.

JIANG Wentao, XU Xiaoqing. Enhanced Foreground Perception Correlation Filtering Target Tracking[J]. Journal of Frontiers of Computer Science and Technology, 2023, 17(10): 2462-2477.

参考文献

[1] 卢湖川, 李佩霞, 王栋. 目标跟踪算法综述[J]. 模式识别与人工智能, 2018, 31(1): 61-76.
LU H C, LI P X, WANG D. Visual object tracking: a survey[J]. Pattern Recognition and Artificial Intelligence, 2018, 31(1): 61-76.
[2] 李彪, 孙瑾, 李星达, 等. 自适应特征融合的相关滤波跟踪算法[J]. 计算机工程与应用, 2022, 58(9): 208-218.
LI B, SUN J, LI X D, et al. Correlation filter target tracking based on adaptive multi-feature fusion[J]. Computer Engineering and Applications, 2022, 58(9): 208-218.
[3] 茅正冲, 陈海东. 自适应尺度的上下文感知相关滤波跟踪算法[J]. 计算机工程与应用, 2021, 57(3): 168-174.
MAO Z C, CHEN H D. Adaptive scale context-aware correlation filter tracking algorithm[J]. Computer Engineering and Applications, 2021, 57(3): 168-174.
[4] 张艳琳, 钱小燕, 张淼, 等. 自适应多特征融合相关滤波目标跟踪[J]. 中国图象图形学报, 2020, 25(6): 1160-1170.
ZHANG Y L, QIAN X Y, ZHANG M, et al. Correlation filter target tracking algorithm based on adaptive multifeatured fusion[J]. Journal of Image and Graphics, 2020, 25(6): 1160-1170.
[5] MAO Z C, CHEN H D. Long-term object tracking algorithm based on kernelized correlation filter[J]. Laser & Optoelectronics Progress, 2019, 56(1): 010702.
[6] 孟琭, 杨旭. 目标跟踪算法综述[J]. 自动化学报, 2019, 45(7): 1244-1260.
MENG L, YANG X. A survey of object tracking algorithms[J]. Acta Automatica Sinica, 2019, 45(7): 1244-1260.
[7] BUCH N, VELASTIN S A, ORWELL J. A review of computer vision techniques for the analysis of urban traffic[J]. IEEE Transactions on Intelligent Transportation Systems, 2011, 12(3): 920-939.
[8] ALLDIECK T, MAGNOR M, XU W, et al. Video based reconstruction of 3D people models[C]//Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, Jun 18-23, 2018. Washington: IEEE Computer Society, 2018: 8387-8397.
[9] WALKER S, SEWELL C, PARK J, et al. Systems and methods for localizing, tracking and/or controlling medical instruments: U.S. Patent 9629595[P]. 2014-09-18.
[10] 葛宝义, 左宪章, 胡永江. 视觉目标跟踪方法研究综述[J]. 中国图象图形学报, 2018, 23(8): 1091-1107.
GE B Y, ZUO X Z, HU Y J. Review of visual object tracking technology[J]. Journal of Image and Graphics, 2018, 23(8): 1091-1107.
[11] 姜文涛, 刘晓璇, 涂潮, 等. 自适应空间异常的目标跟踪[J]. 模式识别与人工智能, 2022, 44(2): 523-533.
JIANG W T, LIU X X, TU C, et al. Spatially abnormal adaptive target tracking[J]. Pattern Recognition and Artificial Intelligence, 2022, 44(2): 523-533.
[12] 朱建章, 王栋, 卢湖川. 学习时空一致性相关滤波的视觉跟踪[J]. 中国科学: 信息科学, 2020, 50(1): 128-150.
ZHU J Z, WANG D, LU H C. Learning temporal-spatial consistency correlation filter for visual tracking[J]. SCIENTIA SINICA Informationis, 2020, 50(1): 128-150.
[13] 袁姮, 赵肖祎. 流形背景感知的相关滤波目标跟踪[J]. 计算机科学与探索, 2023, 17(6): 1373-1386.
YUAN H, ZHAO X Y. Manifold background-aware correlation filter target tracking[J]. Journal of Frontiers of Computer Science and Technology, 2023, 17(6): 1373-1386.
[14] BOLME D S, BEVERIDGE J R, DRAPER B A, et al. Visual object tracking using adaptive correlation filters[C]//Proceedings of the 23rd IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, Jun 13-18, 2010. Washington: IEEE Computer Society, 2010: 2544-2550.
[15] DANELLJAN M, H?GER G, KHAN F, et al. Accurate scale estimation for robust visual tracking[C]//Proceedings of the 2014 British Machine Vision Conference, Nottingham, Sep 1-5, 2014. Durham: BMVA Press, 2014: 1-11.
[16] HENRIQUES J F, CASEIRO R, MARTINS P, et al. High-speed tracking with kernelized correlation filters[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 37(3): 583-596.
[17] DANELLJAN M, HAGER G, SHAHBAZ KHAN F, et al. Learning spatially regularized correlation filters for visual tracking[C]//Proceedings of the 2015 IEEE International Conference on Computer Vision, Santiago, Dec 7-13, 2015.Washington: IEEE Computer Society, 2015: 4310-4318.
[18] BERTINETTO L, VALMADRE J, GOLODETZ S, et al. Staple: complementary learners for real-time tracking[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, Jun 27-30, 2016. Washington: IEEE Computer Society, 2016: 1401-1409.
[19] DANELLJAN M, H?GER G, KHAN F S, et al. Discriminative scale space tracking[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 39(8): 1561-1575.
[20] GALOOGAHI H K, FAGG A, LUCEY S. Learning background-aware correlation filters for visual tracking[C]//Proceedings of the 2017 IEEE International Conference on Computer Vision, Venice, Oct 22-29, 2017. Washington:IEEE Computer Society, 2017: 1144-1152.
[21] LI F, TIAN C, ZUO W, et al. Learning spatial-temporal regularized correlation filters for visual tracking[C]//Pro-ceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, Jun 18-22, 2018. Washington: IEEE Computer Society, 2018: 4904-4913.
[22] HUANG Z, FU C, LI Y, et al. Learning aberrance repressed correlation filters for real-time UAV tracking[C]//Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision, Seoul, Oct 27-Nov 2, 2019. Piscataway: IEEE, 2019: 2891-2900.
[23] LI Y, FU C, DING F, et al. AutoTrack: towards high-performance visual tracking for UAV with automatic spatio-temporal regularization[C]//Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, Jun 13-19, 2020. Piscataway: IEEE, 2020: 11920-11929.
[24] XU T, FENG Z, WU X J, et al. Adaptive channel selection for robust visual object tracking with discriminative correlation filters[J]. International Journal of Computer Vision, 2021, 129(5): 1359-1375.
[25] POSSEGGER H, MAUTHNER T, BISCHOF H. In defense of color-based model-free tracking[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition, Boston, Jun 7-12, 2015. Washington: IEEE Computer Society, 2015: 2113-2120.
[26] WANG M, LIU Y, HUANG Z. Large margin object tracking with circulant feature maps[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, Jul 21-26, 2017. Washington: IEEE Computer Society, 2017: 4800-4808.
[27] 邱道尹, 张文静, 顾波, 等. 帧差法在运动目标实时跟踪中的应用[J]. 华北水利水电学院学报, 2009, 30(3): 45-64.
QIU D Y, ZHANG W J, GU B, et al. Application of frame difference methods in real-time moving target tracking[J]. Journal of North China Institute of Water Conservancy and Hydroelectric Power, 2009, 30(3): 45-64.
[28] 陈俊超, 李刚. 一种抗遮挡的多运动目标跟踪改进算法[J]. 小型微型计算机系统, 2012, 33(2): 307-310.
CHEN J C, LI G. Improved anti-occlusion tracking algorithm of multiple moving object[J]. Journal of Chinese Computer Systems, 2012, 33(2): 307-310.