面向方面抽取与情感分类的多任务联合建模

doi:10.3778/j.issn.1673-9418.2203027

摘要/Abstract

摘要： 基于方面的细粒度情感分析包括方面术语抽取和方面情感分类两项任务，以独立方式解决以上两项任务的研究方法无法利用彼此之间的关联信息，同时也会造成训练冗余和资源浪费。针对上述问题，在多任务学习框架下提出一种基于位置嵌入和图卷积网络的联合模型（PE-GCN），以端到端方式整体解决方面术语抽取和方面情感分类。该模型首先通过双向门控循环单元网络学习句子的语义特征表示；随后利用位置嵌入增强句子中方面术语的识别，同时使用图卷积网络生成包含句法信息的上下文表示；最后通过交互注意力网络建模上下文和方面术语之间的语义关系，并通过softmax输出方面术语的情感极性。在SemEval-2014公开数据集上的实验结果表明，提出的模型与其他现有模型相比性能有显著的提升。

关键词: 方面术语抽取, 方面情感分类, 位置嵌入, 图卷积网络, 交互注意力

Abstract: Fine-grained aspect-based sentiment analysis involves aspect term extraction and aspect sentiment classi-fication. Most existing research methods address them in an independent fashion, which lack a mechanism to account for the relevant information between each other, resulting in training redundancy and waste of resources. To solve the above problems, a joint model based on position embedding and graph convolutional network (PE-GCN) under the framework of multi-task learning is proposed, which is an end-to-end approach to the overall solution of aspect term extraction and aspect sentiment classification. Firstly, the model learns the semantic feature representation of sentence through a bidirectional gated recurrent unit network. Then, it exploits positional embedding to enhance the recognition of aspect terms in sentence, and uses the graph convolutional network to generate a contextual representation containing syntactic information. Finally, interactive attention network is used to model the semantic relationship between context and aspect terms, and the sentiment polarity of aspect terms is output through softmax. Experimental results on the SemEval-2014 public datasets show that the performance of the proposed model has a significant improvement compared with other existing models.

Key words: aspect term extraction, aspect sentiment classification, position embedding, graph convolutional network, interactive attention

孟甜甜, 韩虎, 吴渊航. 面向方面抽取与情感分类的多任务联合建模[J]. 计算机科学与探索, 2023, 17(7): 1669-1679.

MENG Tiantian, HAN Hu, WU Yuanhang. Joint Modeling Based on Multi-task Learning for Aspect Term Extraction and Sen-timent Classification[J]. Journal of Frontiers of Computer Science and Technology, 2023, 17(7): 1669-1679.

参考文献

[1] PONTIKI M, GALANIS D, PAVLOPOULOS J, et al. Sem-Eval-2014 task 4: aspect based sentiment analysis[C]//Pro-ceedings of the 8th International Workshop on Semantic Evaluation, Dublin, Aug 23-24, 2014. Stroudsburg: ACL, 2014: 27-35.
[2] PORIA S, CAMBRIA E, GELBUKH A. Aspect extraction for opinion mining with a deep convolutional neural network[J]. Knowledge-Based Systems, 2016, 108: 42-49.
[3] TANG D Y, QIN B, FENG X C, et al. Effective LSTMs for target-dependent sentiment classification[C]//Proceedings of the 26th International Conference on Computational Lin-guistics, Osaka, Dec 11-17, 2016. Stroudsburg: ACL, 2016: 3298-3307.
[4] AKHTAR M S, GUPTA D, EKBAL A, et al. Feature selection and ensemble construction: a two-step method for aspect-based sentiment analysis[J]. Knowledge-Based Systems, 2017, 125: 116-135.
[5] LI X, BING L D, LI P J, et al. Aspect term extraction with history attention and selective transformation[C]//Proceedings of the 27th International Joint Conference on Artificial In-telligence, Stockholm, Jul 13-19, 2018: 4194-4200.
[6] HUANG B, OU Y L, CARLEY K M. Aspect level sentiment classification with attention-over-attention neural networks[C]//LNCS 10899: Proceedings of the 11th International Con-ference on Social, Cultural, and Behavioral Modeling, Wa-shington, Jul 10-13, 2018. Cham: Springer, 2018: 179-206.
[7] JAKOB N, GUREVYCH I. Extracting opinion targets in a single and cross-domain setting with conditional random fields[C]//Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, Cambridge, Oct 9-11, 2010. Stroudsburg: ACL, 2010: 1035-1045.
[8] MA D H, LI S J, WU F Z, et al. Exploring sequence-to-sequence learning in aspect term extraction[C]//Proceedings of the 57th Annual Meeting of the Association for Compu-tational Linguistics, Florence, Jul 28-Aug 2, 2019. Strouds-burg: ACL, 2019: 3538-3547.
[9] MA D H, LI S J, ZHANG X D, et al. Interactive attention networks for aspect-level sentiment classification[C]//Procee-dings of the 26th International Joint Conference on Arti-ficial Intelligence, Melbourne, Aug 19-25, 2017: 4068-4074.
[10] ZHANG C, LI Q C, SONG D W. Aspect-based sentiment classification with aspect-specific graph convolutional net-works[C]//Proceedings of the 2019 Conference on Empiri-cal Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Pro-cessing, Hong Kong, China, Nov 3-7, 2019. Stroudsburg: ACL, 2019: 4568-4578.
[11] WANG W Y, PAN S J, DAHLMEIER D, et al. Recursive neural conditional random fields for aspect-based sentiment analysis[C]//Proceedings of the 2016 Conference on Empi-rical Methods in Natural Language Processing, Austin, Nov 1-4, 2016. Stroudsburg: ACL, 2016: 616-626.
[12] WANG W Y, PAN S J, DAHLMEIER D, et al. Coupled multi-layer attentions for co-extraction of aspect and opinion terms[C]//Proceedings of the 31st AAAI Conference on Artificial Intelligence, San Francisco, Feb 4-9, 2017. Menlo Park: AAAI, 2017: 3316-3322.
[13] ZHAO H, HUANG L T, ZHANG R, et al. SpanMlt: a span-based multi-task learning framework for pair-wise aspect and opinion terms extraction[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Jul 5-10, 2020. Stroudsburg: ACL, 2020: 3239-3248.
[14] WANG F X, LAN M, Wang W T. Towards a one-stop solu-tion to both aspect extraction and sentiment analysis tasks with neural multi-task learning[C]//Proceedings of the 2018 International Joint Conference on Neural Networks, Rio de Janeiro, Jul 8-13, 2018. Piscataway: IEEE, 2018: 1-8.
[15] LI X, BING L D, LI P J, et al. A unified model for opinion target extraction and target sentiment prediction[C]//Procee-dings of the 33rd AAAI Conference on Artificial Intelligence, the 31st Innovative Applications of Artificial Intelligence Conference, the 9th AAAI Symposium on Educational Ad-vances in Artificial Intelligence, Honolulu, Jan 27-Feb 1, 2019. Menlo Park: AAAI, 2019: 6714-6721.
[16] LUO H S, LI T R, LIU B, et al. DOER: dual cross-shared RNN for aspect term-polarity co-extraction[C]//Proceedings of the 57th Annual Meeting of the Association for Computa-tional Linguistics, Florence, Jul 28-Aug 2, 2019. Strouds-burg: ACL, 2019: 591-601.
[17] HE R D, LEE W S, NG H T, et al. An interactive multi-task learning network for end-to-end aspect-based sentiment analysis[C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Jul 28-Aug 2, 2019. Stroudsburg: ACL, 2019: 504-515.
[18] AKHTAR M S, GARG T, EKBAL A. Multi-task learning for aspect term extraction and aspect sentiment classifica-tion[J]. Neurocomputing, 2020, 398: 247-256.
[19] ZHANG M, QIAN T Y. Convolution over hierarchical syntactic and lexical graphs for aspect level sentiment analysis[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, Nov 16-20, 2020. Strouds-burg: ACL, 2020: 3540-3549.
[20] BAI X F, LIU P B, ZHANG Y. Investigating typed syntactic dependencies for targeted sentiment classification using graph attention neural network[J]. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2021, 29: 503-514.
[21] PHAN M H, OGUNBONA P O. Modelling context and syntactical features for aspect-based sentiment analysis[C]// Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Jul 5-10, 2020. Stroudsburg: ACL, 2020: 3211-3220.
[22] VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]//Proceedings of the Annual Conference on Neural Information Processing Systems 2017, Long Beach, Dec 4-9, 2017. Red Hook: Curran Associates, 2017: 5998-6008.
[23] YOU J X, YING R, REN X, et al. GraphRNN: a deep generative model for graphs[J]. arXiv:1802.08773, 2018.
[24] 苏锦钿, 欧阳志凡, 余珊珊. 基于依存树及距离注意力的句子属性情感分类[J]. 计算机研究与发展, 2019, 56(8): 1731-1745.
SU J D, OUYANG Z F, YU S S. Aspect-level sentiment classification for sentences based on dependency tree and distance attention[J]. Journal of Computer Research and De-velopment, 2019, 56(8): 1731-1745.
[25] PENNINGTON J, SOCHER R, MANNING C. GloVe: global vectors for word representation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Pro-cessing, Doha, Oct 25-29, 2014. Stroudsburg: ACL, 2014: 1532-1543.