畸变感知相关滤波目标跟踪算法

doi:10.3778/j.issn.1673-9418.2209093

摘要/Abstract

摘要： 针对现有相关滤波跟踪算法在目标畸变情况下应对能力不足和滤波器模型更新存在误差累积易导致跟踪失败的问题，提出畸变感知相关滤波目标跟踪算法。首先，利用粒子采样构建强化目标信息的空间参考权值，适应相邻帧间目标外观变化，使滤波器专注于学习目标可信赖部分，抑制背景干扰信息；其次，采用交替方向乘子法以较少的迭代次数求解目标最优函数值，优化算法，降低计算复杂度；最后，为进一步增强滤波器的判别能力，设计目标畸变感知策略，通过分析平均峰值相关能量和响应图峰值时序约束来衡量目标受干扰因素影响后的畸变程度，判别当前跟踪结果是否可靠。当目标跟踪定位可靠性较低时，采用粒子滤波对目标进行选择性的重检测。并依据当前跟踪目标畸变程度，自适应地更新滤波器模型。在OTB50、OTB100和DTB70数据集上与多种代表性目标跟踪算法进行对比实验，实验结果表明，该算法的跟踪成功率和精确率较优，在面对实际场景中因多个干扰因素而产生畸变的目标时具有较强鲁棒性。

关键词: 目标跟踪, 粒子滤波, 相关滤波, 自适应空间正则项, 畸变感知

Abstract: A distortion-aware correlation filter object tracking algorithm is proposed to address the problem that the existing correlation filters have insufficient ability to deal with target distortion and the filter model updating error accumulation easily leads to tracking failure. Firstly, particle sampling is used to construct a spatial reference weight for enhancing the target information and adapt to changes in the target appearance between adjacent frames so that the filter is focused on the reliable part of the learning target and the interference of background information is suppressed. Meanwhile, to optimize the algorithm and reduce computational complexity, the alternating direction multiplier method is used to solve the objective optimal function value with fewer iterations. Finally, to further enhance the discrimination ability of the filter, a target distortion-aware strategy is designed, which combines the average peak correlation energy and the response map peak temporal constrain to measure the distortion of the target affected by interference factors and to determine whether the current tracking result is reliable. When the reliability of target tracking and positioning is low, the particle filter is used to selectively re-detect the target. Depending on the extent of distortion of the tracking target at any given time, the filter model is adaptively updated. Compared with various representative correlation filters on the OTB50, OTB100, and DTB70 datasets, the experimental results show that the tracking success rate and precision of the distortion-aware correlation filter object tracking algorithm are the best, and it has strong robustness in the face of targets distorted by multiple interference factors in the actual scene.

Key words: object tracking, particle filter, correlation filter, adaptive spatial regularization, distortion-aware

姜文涛, 任金瑞. 畸变感知相关滤波目标跟踪算法[J]. 计算机科学与探索, 2023, 17(11): 2703-2720.

JIANG Wentao, REN Jinrui. Distortion-Aware Correlation Filter Object Tracking Algorithm[J]. Journal of Frontiers of Computer Science and Technology, 2023, 17(11): 2703-2720.

参考文献

[1] 刘艺, 李蒙蒙, 郑奇斌, 等. 视频目标跟踪算法综述[J]. 计算机科学与探索, 2022, 16(7): 1504-1515.
LIU Y, LI M M, ZHENG Q B, et al. Survey on video object tracking algorithms[J]. Journal of Frontiers of Computer Science and Technology, 2022, 16(7): 1504-1515.
[2] 李彪, 孙瑾, 李星达, 等. 自适应特征融合的相关滤波跟踪算法[J]. 计算机工程与应用, 2022, 58(9): 208-218.
LI B, SUN J, LI X D, et al. Correlation filter target tracking based on adaptive multi-feature fusion[J]. Computer Engin-eering and Applications, 2022, 58(9): 208-218.
[3] 卢湖川, 李佩霞, 王栋. 目标跟踪算法综述[J]. 模式识别与人工智能, 2018, 31(1): 61-76.
LU H C, LI P X, WANG D. Visual object tracking: a survey[J]. Pattern Recognition and Artificial Intelligence, 2018, 31(1): 61-76.
[4] 张微, 康宝生. 相关滤波目标跟踪进展综述[J]. 中国图象图形学报, 2017, 22(8): 1017-1033.
ZHANG W, KANG B S. Recent advances in correlation filter-based object tracking: a review[J]. Journal of Image and Graphics, 2017, 22(8): 1017-1033.
[5] 张诗桂, 朱立新, 赵义正. 粒子滤波算法研究进展与展望[J]. 自动化技术与应用, 2010, 29(6): 1-9.
ZHANG S G, ZHU L X, ZHAO Y Z. The development and prospect of particle filtering algorithm[J]. Techniques of Automation and Applications, 2010, 29(6): 1-9.
[6] BOLME D S, BEVERIDGE J R, DRAPER B A, et al. Visual object tracking using adaptive correlation filters[C]//Proceedings of the 33rd IEEE Computer Society Confer-ence on Computer Vision and Pattern Recognition, San Francisco, Jun 13-18, 2010. Washington: IEEE Computer Society, 2010: 2544-2550.
[7] HENRIQUES J F, CASEIRO R, MARTINS P, et al. High-speed tracking with kernelized correlation filters[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 37(3): 583-596.
[8] HENRIQUES J F, CASEIRO R, MARTINS P, et al. Expl-oiting the circulant structure of tracking-by-detection with kernels[C]//LNCS 7575: Proceedings of the 12th European Conference on Computer Vision, Oct 7-13, 2012. Berlin, Heidelberg: Springer, 2012: 702-715.
[9] LI Y, ZHU J. A scale adaptive kernel correlation filter tracker with feature integration[C]//LNCS 8926: Proceedings of the 13th European Conference on Computer Vision, Sep 6-7 and 12, 2014. Cham: Springer, 2014: 254-265.
[10] DANELLJAN M, HAGER G, KHAN F S, et al. Discri-minative scale space tracking[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 39(8): 1561-1575.
[11] DANELLJAN M, HAGER G, KHAN F S, et al. Learning spatially regularized correlation filters for visual tracking[C]//Proceedings of the 2015 IEEE International Confe-rence on Computer Vision, Santiago, Dec 7-13, 2015. Wash-ington: IEEE Computer Society, 2015: 4310-4318.
[12] DAI K, WANG D, LU H, et al. Visual tracking via adaptive spatially-regularized correlation filters[C]//Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, Jun 16-20, 2019. Piscat-away: IEEE, 2019: 4670-4679.
[13] LI F, TIAN C, ZUO W, et al. Learning spatial-temporal regularized correlation filters for visual tracking[C]//Proc-eedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, Jun 18-22, 2018.Washington: IEEE Computer Society, 2018: 4904-4913.
[14] 袁姮, 赵肖祎. 流形背景感知的相关滤波目标跟踪[J]. 计算机科学与探索, 2023, 17(6): 1373-1386.
YUAN H, ZHAO X Y. Manifold background-aware corre-lation filter target tracking[J]. Journal of Frontiers of Computer Science and Technology, 2023, 17(6): 1373-1386.
[15] ZHANG J, LIU Y, LIU H, et al. Learning local-global multiple correlation filters for robust visual tracking with Kalman filter redetection[J]. Sensors, 2021, 21(4): 1129-1148.
[16] 蒲磊, 冯新喜, 侯志强, 等. 基于深度空间正则化的相关滤波跟踪算法[J]. 电子学报, 2020, 48(10): 2025-2032.
PU L, FENG X X, HOU Z Q, et al. Correlation filter tracking based on deep spatial regularization[J]. Acta Electonica Sinica, 2020, 48(10): 2025-2032.
[17] FENG S, HU K, FAN E, et al. Kalman filter for spatial-temporal regularized correlation filters[J]. IEEE Transacti-ons on Image Processing, 2021, 30: 3263-3278.
[18] CRAMMER K, DEKEL O, KESHET J, et al. Online passive aggressive algorithms[J]. Journal of Machine Learning Research, 2006, 7: 551-585.
[19] 罗伟丽, 周芸, 张博龙. 非线性非高斯条件下基于粒子滤波的目标跟踪[J]. 国外电子测量技术, 2021, 40(7): 45-51.
LUO W L, ZHOU Y, ZHANG B L. Target tracking based on particle filter under nonlinear and non-Gaussian condi-tions[J]. Foreign Electronic Measurement Technology, 2021, 40(7): 45-51.
[20] WANG M, LIU Y, HUANG Z. Large margin object trac-king with circulant feature maps[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, Jul 21-26, 2017. Washington: IEEE Computer Society, 2017: 4800-4808.
[21] DANELLJAN M, BHAT G, SHAHBAZ KHAN F, et al. ECO: efficient convolution operators for tracking[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, Jul 21-26, 2017.Washington: IEEE Computer Society, 2017: 6931-6939.
[22] WU Y, LIM J, YANG M H. Online object tracking: a benchmark[C]//Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, Jun 23-28, 2013. Washington: IEEE Computer Society, 2013: 2411-2418.
[23] WU Y, LIM J, YANG M H. Object tracking benchmark[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(9): 1834-1848.
[24] LI S, YEUNG D Y. Visual object tracking for unmanned aerial vehicles: a benchmark and new motion models[C]//Proceedings of the 31st AAAI Conference on Artificial Intelligence, San Francisco, Feb 4-9, 2017. Menlo Park: AAAI, 2017: 4140-4146.
[25] BERTINETTO L, VALMADRE J, GOLODETZ S, et al. Staple: complementary learners for real-time tracking[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, Jun 27-30, 2016. Washington: IEEE Computer Society, 2016: 1401-1409.
[26] GALOOGAHI H K, FAGG A, LUCEY S. Learning back-ground-aware correlation filters for visual tracking[C]//Proceedings of the 2017 IEEE International Conference on Computer Vision, Venice, Oct 22-29, 2017. Washington:IEEE Computer Society, 2017: 1144-1152.
[27] HUANG Z, FU C, LI Y, et al. Learning aberrance repressed correlation filters for real-time UAV tracking[C]//Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision, Seoul, Oct 27-Nov 2, 2019. Piscataway: IEEE, 2019: 2891-2900.
[28] LI Y, FU C, DING F, et al. AutoTrack: towards high-performance visual tracking for UAV with automatic spatio-temporal regularization[C]//Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Reco-gnition, Seattle, Aug 7-9, 2020. Piscataway: IEEE, 2020: 11920-11929.
[29] ZHANG F, MA S, ZHANG Y, et al. Perceiving temporal environment for correlation filters in real-time UAV trac-king[J]. IEEE Signal Processing Letters, 2022, 29(1): 6-10.
[30] XU T, FENG Z, WU X J, et al. Adaptive channel selection for robust visual object tracking with discriminative correlation filters[J]. International Journal of Computer Vision, 2021, 129(5): 1359-1375.
[31] DANELLJAN M, H?GER G, KHAN F S, et al. Convo-lutional features for correlation filter based visual tracking[C]//Proceedings of the 2015 IEEE International Confe-rence on Computer Vision Workshop, Santiago, Dec 7-13, 2015. Washington: IEEE Computer Society, 2015: 621-629.
[32] HONG S, YOU T, KWAK S, et al. Online tracking by learning discriminative saliency map with convolutional neural network[C]//Proceedings of the 32nd International Conference on Machine Learning, Lille, Jul 6-11, 2015: 597-606.
[33] LI X, MA C, WU B, et al. Target-aware deep tracking[C]//Proceedings of the 2019 IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, Jun 16-20, 2019. Piscataway: IEEE, 2019: 1369-1378.