Journal of Frontiers of Computer Science and Technology ›› 2022, Vol. 16 ›› Issue (2): 395-402.DOI: 10.3778/j.issn.1673-9418.2009003

• Artificial Intelligence • Previous Articles     Next Articles

Aspect-Based Sentiment Analysis Model with Multiple Grammatical Information

XIAO Zeguan1, CHEN Qingliang1,2,+()   

  1. 1. Department of Computer Science, Jinan University, Guangzhou 510632, China
    2. Yunqu-Jinan University Joint AI Research Center, Guangzhou 510632, China
  • Received:2020-09-03 Revised:2021-01-08 Online:2022-02-01 Published:2021-01-28
  • About author:XIAO Zeguan, born in 1995, M.S. candidate. His research interests include natural language processing, aspect based sentiment analysis, etc.
    CHEN Qingliang, born in 1980, Ph.D., professor. His research interests include machine learning, natural language processing, etc.
  • Supported by:
    National Natural Science Foundation of China(61772232)

融合多种类型语法信息的属性级情感分析模型

肖泽管1, 陈清亮1,2,+()   

  1. 1.暨南大学 计算机科学系,广州 510632
    2.云趣科技-暨南大学人工智能联合研发中心,广州 510632
  • 通讯作者: + E-mail: tpchen@jnu.edu.cn
  • 作者简介:肖泽管(1995—),男,海南万宁人,硕士研究生,主要研究方向为自然语言处理、属性级情感分析等。
    陈清亮(1980—),男,广东韶关人,博士,教授,主要研究方向为机器学习、自然语言处理等。
  • 基金资助:
    国家自然科学基金(61772232)

Abstract:

The aim of aspect based sentiment analysis (ABSA) is to classify the sentiment polarity towards a particular aspect in a sentence. Existing approaches usually apply attention mechanism to modeling the connection between aspects and opinion expression in an implicit way. However, they ignore the potentially useful grammatical information. On one hand, the sentiment polarity of an aspect is closely related to opinion expression, and syntactic information helps to better model the relation of them. On the other hand, models are hard to learn general grammatical knowledge when trained on existing small benchmark datasets, resulting in difficulty to handle complex sentence patterns and opinion expressions. To address the problem, this paper proposes a neural network that combines various kinds of grammatical information to enhance the accuracy. This paper employs dependency tree based graph convolutional networks (GCN) to match aspects and their corresponding opinion expression directly using syntactic information and eliminate useless information. This paper also uses middle layers of BERT as guiding information to enhance the model, which contains various kinds of contextual and grammatical information. The input of each GCN layer fuses the output of the preceding GCN layer and BERT (bidirectional encoder representations from transformers) middle layers. Finally, the aspect representation of the last layer GCN is used as the feature to identify sentiment polarity. Experiments on SemEval 2014 Task4 Restaurant, Laptop and Twitter show the model outperforms other baselines.

Key words: aspect, sentiment analysis, bidirectional encoder representations from transformers (BERT), dependency tree, graph convolutional networks (GCN)

摘要:

属性级情感分析(ABSA)的目标是识别出句子中属性的情感倾向。现有的方法大多使用注意力机制隐性地建模属性与上下文中情感表达的关系,而忽略了使用语法信息。一方面,属性的情感倾向与句子中的情感表达有紧密的联系,利用句子的句法结构可以更直接地对两者建模;另一方面,由于现有的基准数据集较小,模型无法充分学习通用语法知识,这使得它们难以处理复杂的句型和情感表达。针对以上问题,提出一种利用多种类型语法信息的神经网络模型。该模型采用基于依存句法树的图卷积神经网络(GCN),并利用句法结构信息直接匹配属性与其对应情感表达,缓解冗余信息对分类的干扰。同时,使用预训练模型BERT具有多种类型的语法信息的中间层表示作为指导信息,给予模型更多的语法知识。每一层GCN的输入结合上一层GCN的输出和BERT中间层指导信息。最后将属性在最后一层GCN的表示作为特征进行情感倾向分类。通过在SemEval 2014 Task4 Restaurant、Laptop和Twitter数据集上的实验结果表明,提出模型的分类效果超越了很多基准模型。

关键词: 属性级, 情感分析, 基于变换器的双向编码器表示技术(BERT), 依存句法树, 图卷积神经网络(GCN)

CLC Number: