Journal of Frontiers of Computer Science and Technology ›› 2024, Vol. 18 ›› Issue (7): 1826-1837.DOI: 10.3778/j.issn.1673-9418.2306003

• Graphics·Image • Previous Articles     Next Articles

Multi-scale and Boundary Fusion Network for Skin Lesion Regions Segmentation

WANG Guokai, ZHANG Xiang, WANG Shunfang   

  1. School of Information Science and Engineering, Yunnan University, Kunming 650504, China
  • Online:2024-07-01 Published:2024-06-28

多尺度和边界融合的皮肤病变区域分割网络

王国凯,张翔,王顺芳   

  1. 云南大学 信息学院,昆明 650504

Abstract: Accurate segmentation of skin lesion regions is a key step in clinical diagnosis and analysis. Aiming at the poor segmentation effect of the existing networks in skin lesion regions due to the presence of variable size, irregular shape, fuzzy boundaries and obscured lesion regions, a multi-scale and boundary fusion network (MSBF-Net) for skin lesion region segmentation is proposed by improving the original structure based on the U-Net. Specifically, firstly, a split pooling (SplitPool) module is proposed, which effectively solves the problem of spatial information loss while reducing the image resolution. Secondly, a full-scale feature fusion (FSFF) module is proposed, which effectively solves the problem that the previous methods only fuse the deep features to the shallow features, while ignoring the contribution of the detail information in the more shallow features to the network segmentation decision. Meanwhile, the original jump connections of U-Net are redesigned to provide richer contextual information for the decoder. Finally, sub-paths for enhancing the network’s ability to learn boundary features are proposed, and the boundary fusion (BF) module is introduced to fuse the prediction results of the main paths and sub-paths, which effectively solves the problems of irregular shape and boundary ambiguity of the lesion region. Dice and JI reach 90.12% and 83.61% on the ISIC2018 dataset, which are 1.13 percentage points and 1.62 percentage points higher than the baseline network, respectively; Dice and JI reach 94.72% and 90.18% on the PH2 dataset, which are 1.49 percentage points and 2.17 percentage points higher than the baseline network, respectively. Experimental results show that MSBF-Net significantly improves the accuracy of skin lesion region segmentation and exceeds the existing state-of-the-art methods in several indices, further validating the effectiveness of the method.

Key words: skin lesion region segmentation, skip connections, boundary feature, feature fusion, attention mechanism

摘要: 皮肤病变区域的准确分割是临床诊断分析的关键一步。针对现有网络在皮肤病变区域存在尺寸大小多变、形状不规则、边界模糊和病变区域被遮挡的情况导致的分割效果不佳问题,在U-Net的基础上改进了原有结构,提出了一种用于皮肤病变区域分割的多尺度和边界融合网络(MSBF-Net)。首先,提出了分裂池化(SplitPool)模块,在缩小图像分辨率的同时有效地解决了空间信息丢失的问题。其次,提出了全尺度特征融合(FSFF)模块,有效地解决了以往方法仅将深层特征向浅层特征融合,而忽略了更浅层特征中的细节信息对网络分割决策的贡献问题。同时,重新设计了U-Net原有的跳跃连接,为解码器提供了更丰富的上下文信息。最后,提出了用于增强网络对边界特征学习能力的子路径,并引入边界融合(BF)模块将主路径和子路径的预测结果进行融合,有效地解决了病变区域形状不规则和边界模糊问题。在ISIC2018数据集上,Dice和JI分别达到了90.12%和83.61%,比基线网络分别提高了1.13个百分点和1.62个百分点;在PH2数据集上,Dice和JI分别达到了94.72%和90.18%,比基线网络分别提高了1.49个百分点和2.17个百分点。实验结果表明,MSBF-Net显著提升了皮肤病变区域分割的精确度,并在多个指标上超过了现有的先进方法,进一步验证了方法的有效性。

关键词: 皮肤病变区域分割, 跳跃连接, 边界特征, 特征融合, 注意力机制