Global and Local Structure Learning for Multi-view Subspace Clustering

doi:10.3778/j.issn.1673-9418.2201077

Abstract

Abstract: Constrained bilinear factorization multi-view subspace clustering algorithm (CBF-MSC) ignores local struc-ture information of views, resulting in loss of information and thus affecting the effect of multi-view clustering. To solve the above problems, a multi-view subspace clustering algorithm based on global and local structure learning (constrained bilinear factorization by learning global and local structures for multi-view subspace clustering, CBF-LGLS) is proposed. The algorithm considers the consistency and complementarity of views, and considers that the coefficient matrices of different views should have the same clustering attributes, rather than being consistent among multiple views, so as to fully explore the underlying data distribution and clustering attributes of mining views. Moreover, the algorithm also fully considers the local structure information of the view, effectively captures the internal differences of a single view and reduces the loss of information. Then, the algorithm comprehensively considers the local structure information of views, effectively capturing the internal differences of a single view and reducing the loss of information. In addition, the algorithm adopts an adaptive weighting method to reduce the impact of noise and redundancy on clustering effect. For the traditional pattern of predefined similarity matrices for each view, an adaptive distance regularization method is adopted to fully consider the geometric structure of a single view and the same cluster structure between views, thereby improving clustering performance. The algorithm is tested on widely-used datasets and compared with mainstream algorithms. The results show that the proposed algorithm obtains good clustering effect and convergence.

Key words: multi-view, clustering, local structure information, consistency

摘要： 约束双线性分解的多视图子空间聚类算法（CBF-MSC）忽略了视图局部结构信息，导致信息损失，进而影响多视图聚类效果。针对上述问题，提出了全局与局部结构学习的多视图子空间聚类算法（CBF-LGLS）。该算法首先考虑了视图的一致性与互补性，认为不同视图的系数矩阵应该具有相同的聚类属性，而不是在多个视图之间是一致的，从而充分探索挖掘视图底层数据分布和聚类属性。该算法还全面考虑了视图的局部结构信息，有效捕获单个视图的内在差异，减少了信息损失。此外，该算法采用了自适应加权的方法，减少了噪声与冗余对聚类效果的影响。对于每个视图预定义相似度矩阵的传统模式，采用了自适应距离正则化方法，达到充分考虑单个视图的几何结构与视图之间相同的簇结构的目的，进而提高聚类效果。算法在广泛使用的数据集上进行实验，并与主流算法进行比较，结果表明，提出的算法具有良好的聚类效果和收敛性。

关键词: 多视图, 聚类, 局部结构信息, 一致性

QIAO Yuxin, GE Hongwei, SONG Peng. Global and Local Structure Learning for Multi-view Subspace Clustering[J]. Journal of Frontiers of Computer Science and Technology, 2023, 17(9): 2107-2117.

乔宇鑫, 葛洪伟, 宋鹏. 全局与局部结构学习的多视图子空间聚类算法[J]. 计算机科学与探索, 2023, 17(9): 2107-2117.

References

[1] ZHAO J, XIE X, XU X, et al. Multi-view learning over-view: recent progress and new challenges[J]. Information Fusion, 2017, 38: 43-54.
[2] FU L, LIN P, VASILAKOS A V, et al. An overview of recent multi-view clustering[J]. Neurocomputing, 2020, 402: 148-161.
[3] KANG Z, GUO Z P, HUANG S D, et al. Multiple partitions aligned clustering[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence, Macao, China,Aug 10-16, 2019: 2701-2707.
[4] SAXENA A, PRASAD M, GUPTA A, et al. A review of clustering techniques and developments[J]. Neurocomputing, 2017, 267: 664-681.
[5] HUANG S D, XU Z, TSANG I W, et al. Auto-weighted multi-view co-clustering with bipartite graphs[J]. Information Sciences, 2020, 512: 18-30.
[6] VENTURA C, VARAS D, VILAPLANA V, et al. Multi-resolution co-clustering for uncalibrated multiview seg-mentation[J]. Signal Processing: Image Communication, 2019, 76: 151-166.
[7] LU Y T, WANG L T, LU J F, et al. Multiple kernel cluster-ing based on centered kernel alignment[J]. Pattern Recog-nition, 2014, 47(11): 3656-3664.
[8] MA S X, LIU Y H, ZHENG Q H, et al. Multiview spectral clustering via complementary information[J]. Concurrency and Computation Practice & Experience, 2020, 33(15): e5701.
[9] WANG H, YANG Y, LIU B. GMC: graph-based multi-view clustering[J]. IEEE Transactions on Knowledge and Data Engineering, 2020, 32(6): 1116-1129.
[10] HUANG S D, KANG Z, TSANG I W, et al. Auto-weighted multi-view clustering via kernelized graph learning[J]. Pattern Recogition, 2019, 88: 174-184.
[11] NIE F P, CAI G H, I X L. Multi-view clustering and semi-supervised classification with adaptive neighbors[C]//Pro-ceedings of the 2017 AAAI Conference on Artificial Intel-ligence, San Francisco, Feb 4-9, 2017. Menlo Park: AAAI, 2017: 2408-2414.
[12] ZHANG C, HU Q, FU H, et al. Latent multi-view subspace clustering[C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, Jul 21-26, 2017. Washington: IEEE Computer Society, 2017: 4333-4341.
[13] ZHENG Q H, ZHU J H, TIAN Z Q, et al. Constrained bilinear factorization multi-view subspace clustering[J]. Knowledge-based Systems, 2020, 194: 105514.
[14] LIN Z, LIU R, SU Z. Linearized alternating direction me-thod with adaptive penalty for low-rank representation[C]//Advances in Neural Information Processing Systems 24, Gra-nada, Dec 12-15, 2011. Red Hook: Curran Associates, 2011: 612-620.
[15] LIU G C, LIN Z C, YAN S C, et al. Robust recovery of subspace structures by low-rank representation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(1): 171-184.
[16] ZHANG Z. A flexible new technique for camera calibration[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(11): 1330-1334.
[17] BOYD S, VANDENBERGHE L, FAYBUSOVICH L. Convex optimization[J]. IEEE Transactions on Automatic Control, 2006, 51(11): 1859.
[18] NG A Y, JORDAN M I, WEISS Y. On spectral clustering: analysis and an algorithm[C]//Advances in Neural Infor-mation Processing Systems 14, Vancouver, Dec 3-8, 2001. Cambridge: MIT Press, 2001: 849-856.
[19] CORTES C, MOHRI M, ROSTAMIZADEH A. Learning non-linear combinations of kernels[C]//Advances in Neural Information Processing Systems 22, Vancouver, Dec 7-10, 2009. Red Hook: Curran Associates, 2009: 396-404.
[20] KUMAR A, RAI P, DAUME H. Co-regularized multi-view spectral clustering[C]//Advances in Neural Information Pro-cessing Systems 24, Granada, Dec 12-15, 2011. Red Hook: Cur-ran Associates, 2011: 1413-1421.
[21] XIA R, PAN Y, DU L, et al. Robust multi-view spectral clustering via low-rank and sparse decomposition[C]//Pro-ceedings of the 28th AAAI Conference on Artificial Intel-ligence, Québec City, Jul 27-31, 2014. Menlo Park: AAAI, 2014: 2149-2155.
[22] NIE F P, LI J, LI X L. Parameter-free auto-weighted mul-tiple graph learning: a framework for multiview clustering and semi-supervised classification[C]//Proceedings of the 25th International Joint Conference on Artificial Intelli-gence, New York, Jul 9-15, 2016. Menlo Park: AAAI, 2016: 1881-1887.
[23] BRBIC M, KOPRIV I. Multi-view low-rank sparse subspace clustering[J]. Pattern Recognition, 2018, 73: 247-258.
[24] LIN S L, GUO Z, TING S. Simultaneously learning fea-turewise weights and local structures for multi-view sub-space clustering[J]. Knowledge-Based Systems, 2020, 205: 106280.