关键词: 模态选择, 自适应跟踪, 实时处理, 热红外信息

Abstract: To alleviate the noises of low quality modalities and improve the efficiency in multimodal object tracking, this paper proposes an adaptive modal selection based method to effectively select most reliable modality to track object. Specifically, for each modal, the clustering algorithm is utilized to divide the object region and its surrounding background region into several sub-clusters, and then the discriminative ability between object and background, which measures the modal quality, is computed by the feature difference between their respective sub-clusters. The most reliable modality is thus selected based on the defined discriminative ability to track object by using the correlation filter algorithm. For maintaining the effective object model, this paper employs double-threshold strategy to update all modal models. Experiments on the collected thermal-visible video pairs demonstrate the effectiveness of the proposed method. In addition, the runtime of the proposed tracker achieves 141 f/s.

Key words: modal selection, adaptive tracking, real-time processing, thermal information