Journal of Frontiers of Computer Science and Technology ›› 2024, Vol. 18 ›› Issue (4): 1057-1067.DOI: 10.3778/j.issn.1673-9418.2302077

• Artificial Intelligence·Pattern Recognition • Previous Articles     Next Articles

Multi-feature Interaction for Aspect Sentiment Triplet Extraction

CHEN Linying, LIU Jianhua, ZHENG Zhixiong, LIN Jie, XU Ge, SUN Shuihua   

  1. 1. School of Computer Science and Mathematics, Fujian University of Technology, Fuzhou 350118, China
    2. Fujian Provincial Key Laboratory of Big Data Mining and Applications, Fuzhou 350118, China
    3. College of Computer and Control Engineering, Minjiang University, Fuzhou 350108, China
  • Online:2024-04-01 Published:2024-04-01

多特征交互的方面情感三元组提取

陈林颖,刘建华,郑智雄,林杰,徐戈,孙水华   

  1. 1. 福建理工大学 计算机科学与数学学院,福州 350118
    2. 福建省大数据挖掘与应用技术重点实验室,福州 350118
    3. 闽江学院 计算机与控制工程学院,福州 350108

Abstract: Aspect sentiment triple extraction is one of the subtasks of aspect-level sentiment analysis, which aims to extract aspect terms, corresponding opinion terms and sentiment polarity in sentence. Previous studies focus on designing a new paradigm to complete the triplet extraction task in an end-to-end manner. They ignore the role of external knowledge in the model, thus semantic information, part-of-speech information and local context information are not fully explored and utilized. Aiming at the above problems, multi-feature interaction for aspect sentiment triplet extraction (MFI-ASTE) is proposed. Firstly, the bidirectional encoder representation from transformers (BERT) model is used to learn the context semantic feature information, meanwhile, the self-attention mechanism is used to strengthen the semantic feature. Secondly, the semantic feature interacts with the extracted part-of-speech feature and both learn from each other to strengthen the combination ability of the part-of-speech and semantic information. Thirdly, many convolutional neural networks are used to extract multiple local context features of each word, and then multi-point gate mechanism is used to filter these features. Fourthly, three features of external knowledge are fused by two linear layers. Finally, biaffine attention is used for predicting grid tagging and specific decoding schemes are used for decoding triplets. Experimental results show that the proposed model improves the F1 score by 6.83%, 5.60%, 0.54% and 1.22% respectively on four datasets compared with existing mainstream models.

Key words: aspect sentiment triplet extraction, self-attention mechanism, convolutional neural network, grid tagging scheme, biaffine attention mechanism

摘要: 方面情感三元组提取是方面级情感分析的子任务之一,旨在提取句子中的方面词、其对应的意见词和情感极性。先前研究集中于设计一种新范式以端到端的方式完成三元组提取任务。然而,这些方法忽略外部知识在模型中的作用,没有充分挖掘和利用语义信息、词性信息以及局部上下文信息。针对上述问题,提出了多特征交互的方面情感三元组提取(MFI-ASTE)模型。首先,该模型通过BERT预训练模型学习句子中的上下文语义特征信息,并使用自注意力机制加强语义特征;其次,使语义特征与所提取到的词性特征交互,二者相互学习,加强词性的组合能力与语义信息;再次,使用多个不同窗口的卷积神经网络提取每个单词的多重局部上下文特征并使用多分门控机制筛选这些多重局部特征;然后,采用双线性层融合提取到的三类外部知识特征;最后,利用双仿射注意力机制预测网格标记并通过特定的解码方案解码三元组。实验结果表明,该模型在四个数据集上的F1值比现有的主流模型分别提升了6.83%、5.60%、0.54%和1.22%。

关键词: 方面情感三元组提取, 自注意力机制, 卷积神经网络, 网格标记方案, 双仿射注意力机制