Journal of Frontiers of Computer Science and Technology ›› 2022, Vol. 16 ›› Issue (9): 2121-2131.DOI: 10.3778/j.issn.1673-9418.2012036

• Graphics and Image • Previous Articles     Next Articles

Co-segmentation of 3D Point Cloud Shape Clusters Based on Weakly Supervised Learning

YANG Jun1,2, LEI Xiwen1,+()   

  1. 1. School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China
    2. Faculty of Geomatics, Lanzhou Jiaotong University, Lanzhou 730070, China
  • Received:2020-12-10 Revised:2021-04-06 Online:2022-09-01 Published:2021-04-25
  • About author:YANG Jun, born in 1973, Ph.D., professor. His research interests include deep learning, computer graphics, remote sensing image interpretation, etc.
    LEI Xiwen, born in 1990, M.S. candidate. His research interests include computer graphics and pattern recognition.
  • Supported by:
    National Natural Science Foundation of China(61862039);Science and Technology Program of Gansu Province(20JR5RA429);Talent Innovation and Entrepreneurship Project of Lanzhou(2020-RC-22);Project of Tianyou Innovation Team of Lanzhou Jiaotong University(TY202002)

弱监督学习下的三维点云模型簇协同分割

杨军1,2, 雷喜文1,+()   

  1. 1.兰州交通大学 电子与信息工程学院,兰州 730070
    2.兰州交通大学 测绘与地理信息学院,兰州 730070
  • 通讯作者: + E-mail: 314702467@qq.com
  • 作者简介:杨军(1973—),男,宁夏吴忠人,博士,教授,主要研究方向为深度学习、计算机图形学、遥感影像解译等。
    雷喜文(1990—),男,甘肃庆阳人,硕士研究生,主要研究方向为计算机图形学、模式识别。
  • 基金资助:
    国家自然科学基金(61862039);甘肃省科技计划资助(20JR5RA429);兰州市人才创新创业项目(2020-RC-22);兰州交通大学天佑创新团队项目(TY202002)

Abstract:

With the rapid development of 3D acquisition technology, point cloud data have gradually become one of the basic data formats to represent 3D shapes, which can retain more raw geometric information of the shape in 3D space. However, in the field of 3D point cloud shape segmentation, most deep learning network architectures rely on high-quality labeled data, which leads to high training cost. Therefore, in order to solve the problem of co-segmen-tation of 3D shape clusters by using training samples with a small number of labeled points, a consistent segmenta-tion of 3D point cloud shape clusters based on weakly supervised learning method is proposed. Firstly, the local neighborhood graph between points is established by K-nearest neighbor algorithm. Then, the feature of the point cloud model is extracted by local convolution method, and similar component matrices are constructed by using the extracted component features. Finally, an energy function reverse iteration is used to optimize the network weights to obtain the consistent segmentation results of the shape clusters. Experimental results show that the segmentation accuracy of this algorithm is 85.0% on ShapeNet Parts. Compared with the existing supervised learning algorithms, when the number of labeled points in the training samples is reduced to 10%, the proposed algorithm can still achieve similar or even better results, and compared with the current mainstream weakly monitoring algorithms, accuracy of the segmentation is further improved.

Key words: shape clusters, co-segmentation, weakly supervised learning, local convolution, energy function

摘要:

随着三维采集技术的快速发展,点云数据逐渐成为表示三维模型的基本数据格式之一,它可以保留模型的更多三维空间几何信息。但在三维点云模型分割研究中,大多深度学习网络架构依赖于高质量标注的数据,导致训练成本高昂。因此,针对利用带少量标注点的训练样本实现三维模型簇协同分割的问题,提出一种基于弱监督学习的三维点云模型簇协同一致分割方法。首先,通过K近邻算法建立点之间的局部邻域图;然后,利用局部卷积方法提取点云模型的部件特征并构建相似部件矩阵;最后,通过能量函数反向传播优化网络权值,获得模型簇的一致性分割结果。实验结果表明,该算法在公开数据集ShapeNet Parts上的分割准确率达到85.0%。与现有的有监督算法相比,该算法在训练样本标签数减少至10%的情况下依然能够取得与有监督学习方法接近甚至更好的分割结果,并且与目前主流的弱监督算法相比,分割准确率得到进一步提升。

关键词: 模型簇, 协同分割, 弱监督学习, 局部卷积, 能量函数

CLC Number: