Incomplete Multi-view Classification via Discriminative and Sparse Representation

doi:10.3778/j.issn.1673-9418.2007006

Abstract

Abstract:

Generally, the traditional multi-view learning methods assume that all samples are completed in all views. However, this assumption often fails in real applications because of limited access to data, equipment malfunc-tion, as well as occlusion and so on. Thus, it is ineffective to directly use these traditional methods for addressing incomplete multi-view data. At present, several effective incomplete learning algorithms have been proposed, but they do not make full use of label information and thus reduce the discrimination of the recovered samples. Therefore, this paper proposes an incomplete multi-view classification method via discriminative and sparse representation (IMVC-DSR). Specifically, this method is based on the assumption that missing samples can be represented linearly and sparsely by a few observed samples. Meanwhile, in order to make full use of label prior information to improve the discrimination of recovered samples, this method encourages that missing samples are represented by the samples from their same classes rather than the others. Also, according to the view consistence across multi-view, this paper designs a selection operator to select the same samples from different views and meanwhile expects their linear representations are consistent with each other. Finally, experiments demonstrate the efficacy of the proposed method on five public benchmark datasets.

Key words: multi-view learning, incomplete multi-view learning, sparse representation, view consistence

摘要：

传统多视图学习通常假设样本在每个视图都是完整的，但是由于数据难以获取、设备故障、遮挡等因素，这一假设并不总能成立，而传统的多视图学习方法很难有效处理不完整多视图数据。目前，研究者们已经提出了一些不完整多视图学习的方法，但是这些方法没有充分利用样本类别信息，从而影响恢复后样本的判别性。因此，提出基于判别稀疏性表示的不完整多视图分类方法（IMVC-DSR）。具体地，该方法假设缺失样本可用少量观测样本稀疏线性表示。同时，为了充分利用类别先验信息，增加恢复后样本的判别性，该方法鼓励相同类别样本之间相互表示，降低不同类别样本之间的相互表达。此外，该方法考虑到视图之间的相关关系，引入选择算子选出不同视图的相同样本，并约束相同样本在不同视图的线性表达具有一致性。最后，在公开的五组数据集上验证了所提方法IMVC-DSR的有效性。

关键词: 多视图学习, 不完整多视图学习, 稀疏表示, 视图一致性

XIN Like, YANG Wanqi, YANG Ming. Incomplete Multi-view Classification via Discriminative and Sparse Representation[J]. Journal of Frontiers of Computer Science and Technology, 2021, 15(10): 1938-1948.

辛利柯, 杨琬琪, 杨明. 基于判别稀疏性表示的不完整多视图分类[J]. 计算机科学与探索, 2021, 15(10): 1938-1948.

References

[1] BLUM A, MITCHELL T M. Combining labeled and unla-beled data with co-training[C]//Proceedings of the 11th Annual Conference on Computational Learning Theory, Madison, Jul 24-26, 1998. New York: ACM, 1998: 92-100.
[2] SCHECHTER I, WAKELING T, WOLLRATH A M. Proce-ssing data from multiple sources: U.S. Patent 9607073[P]. 2017-03-28.
[3] HU M, CHEN S. Doubly aligned incomplete multi-view clus-tering[C]//Proceedings of the 27th International Joint Con-ference on Artificial Intelligence, Stockholm, Jul 13-19, 2018: 2262-2268.
[4] XU C, TAO D, XU C. A survey on multi-view learning[J]. arXiv:1304.5634, 2013.
[5] XU C, TAO D C, XU C. Multi-view learning with incomp-lete views[J]. IEEE Transactions on Image Processing, 2015, 24(12): 5812-5825.
[6] BREFELD U, G?RTNER T, SCHEFFER T, et al. Efficient co-regularised least squares regression[C]//Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, Jun 25-29, 2006. New York: ACM, 2006: 137-144.
[7] SINDHWANI V, NIYOGI P, BELKIN M. A co-regulari-zation approach to semi-supervised learning with multiple views[C]//Proceedings of the 2005 Workshop on Learning with Multiple Views, Bonn, 2005: 74-79.
[8] NIGAM K, GHANI R. Analyzing the effectiveness and app-licability of co-training[C]//Proceedings of the 2000 ACM CIKM International Conference on Information and Know-ledge Management, McLean, Nov 6-11, 2000. New York: ACM, 2000: 86-93.
[9] WANG W, ZHOU Z H. A new analysis of co-training[C]//Proceedings of the 27th International Conference on Machine Learning, Haifa, Jun 21-24, 2010. Madison: Omnipress, 2010: 1135-1142.
[10] LANCKRIET G R G, CRISTIANINI N, BARTLETT P, et al. Learning the kernel matrix with semidefinite programming[J]. Journal of Machine Learning Research, 2004, 5: 27-72.
[11] BACH F R, LANCKRIET G R G, JORDAN M I. Multiple kernel learning, conic duality, and the SMO algorithm[C]//Proceedings of the 21st International Conference on Mach-ine Learning, Banff, Jul 4-8, 2004. New York: ACM, 2004: 6.
[12] SONNENBURG S, R?TSCH G, SCH?FER C, et al. Large scale multiple kernel learning[J]. Journal of Machine Lear-ning Research, 2006, 7(7): 1531-1565.
[13] RAKOTOMAMONJY A, BACH F R, CANU S, et al. Simple-MKL[J]. Journal of Machine Learning Research, 2008, 9(11): 2491-2521.
[14] CHAUDHURI K, KAKADE S M, LIVESCU K, et al. Multi-view clustering via canonical correlation analysis[C]//Proc-eedings of the 26th Annual International Conference on Mac-hine Learning, Montreal, Jun 14-18, 2009. New York: ACM, 2009: 129-136.
[15] SIGAL L, MEMISEVIC R, FLEET D J. Shared kernel infor-mation embedding for discriminative inference[C]//Procee-dings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, Jun 20-25, 2009. Washington: IEEE Computer Society, 2009: 2852-2859.
[16] ZHU X Z, LIU X W, LI M M, et al. Localized incomplete multiple kernel k-means[C]//Proceedings of the 27th Inter-national Joint Conference on Artificial Intelligence, Stockholm, Jul 13-19, 2018: 3271-3277.
[17] YANG W Q, SHI Y H, GAO Y, et al. Incomplete-data oriented multiview dimension reduction via sparse low-rank represen-tation[J]. IEEE Transactions on Neural Networks and Learning Systems, 2018, 29(12): 6276-6291.
[18] ZHAO H D, LIU H F, FU Y. Incomplete multi-modal visual data grouping[C]//Proceedings of the 25th International Joint Conference on Artificial Intelligence, New York, Jul 9-15, 2016. Menlo Park: AAAI, 2016: 2392-2398.
[19] YIN Q Y, WU S, WANG L. Unified subspace learning for incomplete and unlabeled multi-view data[J]. Pattern Recogni-tion, 2017, 67: 313-327.
[20] THUNG K H, ADELI E, YAP P T, et al. Stability-weighted matrix completion of incomplete multi-modal data for disease diagnosis[C]//LNCS 9901: Proceedings of the 19th International Conference on Medical Image Computing and Computer-Assisted Intervention, Athens, Oct 17-21, 2016. Berlin, Heidelberg: Springer, 2016: 88-96.
[21] ZANTEDESCHI V, EMONET R, SEBBAN M. Fast and provably effective multi-view classification with landmark-based SVM[C]//LNCS 11052: Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, Dublin, Sep 10-14, 2018. Cham: Springer, 2018: 193-208.
[22] ZHAO J, XIE X, XU X, et al. Multi-view learning overview: recent progress and new challenges[J]. Information Fusion, 2017, 38: 43-54.
[23] YU S P, KRISHNAPURAM B, ROSALES R, et al. Bayesian co-training[C]//Proceedings of the 21st Annual Conference on Neural Information Processing Systems, Vancouver, Dec 3-6, 2007. Red Hook: Curran Associates, 2007: 1665-1672.
[24] ZHAO X R, EVANS N W D, DUGELAY J L. A subspace co-training framework for multi-view clustering[J]. Pattern Reco-gnition Letters, 2014, 41: 73-82.
[25] DING Z M, FU Y. Low-rank common subspace for multi-view learning[C]//Proceedings of the 2014 IEEE International Conference on Data Mining, Shenzhen, Dec 14-17, 2014: 110-119.
[26] GUO Y H. Convex subspace representation learning from multi-view data[C]//Proceedings of the 27th AAAI Conference on Artificial Intelligence, Bellevue, Jul 14-18, 2013. Menlo Park: AAAI, 2013: 387-393.
[27] YIN Q Y, WU S, WANG L. Incomplete multi-view cluster-ing via subspace learning[C]//Proceedings of the 24th ACM International Conference on Information and Knowledge Mana-gement, Melbourne, Oct 19-23, 2015. New York: ACM, 2015: 383-392.
[28] SHAO W X, HE L F, PHILIP S Y. Multiple incomplete views clustering via weighted nonnegative matrix factorization with L2,1 regularization[C]//LNCS 9284: Proceedings of the Euro-pean Conference on Machine Learning and Knowledge Dis-covery in Databases, Porto, Sep 7-11, 2015. Cham: Springer, 2015: 318-334.
[29] LI S Y, JIANG Y, ZHOU Z H. Partial multi-view clustering[C]//Proceedings of the 28th AAAI Conference on Artificial Intelligence, Québec City, Jul 27-31, 2014. Menlo Park: AAAI, 2014: 1968-1974.
[30] YANG Y, ZHAN D C, SHENG X R, et al. Semi-supervised multi-modal learning with incomplete modalities[C]//Procee-dings of the 27th International Joint Conference on Artificial Intelligence, Stockholm, Jul 13-19, 2018: 2998-3004.
[31] YANG Y, ZHAN D C, WU Y F, et al. Semi-supervised multi-modal clustering and classification with incomplete modalities[J]. IEEE Transactions on Knowledge and Data Engineering, 2021, 33(2): 682-695.
[32] BECK A, TEBOULLE M. A fast iterative shrinkage-thresholding algorithm for linear inverse problems[J]. SIAM Journal on Imaging Sciences, 2009, 2(1): 183-202.
[33] SUN Q S, ZENG S G, LIU Y, et al. A new method of feature fusion and its application in image recognition[J]. Pattern Recognition, 2005, 38(12): 2437-2448.
[34] SHEKHAR S, PATEL V M, NASRABADI N M, et al. Joint sparse representation for robust multimodal biometrics recog-nition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 36(1): 113-126.