Recommendation Algorithm Combining Knowledge Graph and Short-Term Preferences

doi:10.3778/j.issn.1673-9418.2008059

Abstract

Abstract:

In recent years, attention has been paid to knowledge graph as auxiliary information to enhance recom-mendation increasedly. Since the goal of the knowledge graph learning task is to restore the relationship of the triples in the knowledge graph, rather than to accomplish the recommendation task, it is difficult for the knowledge graph learning task to efficiently help the recommendation task improve the recommendation performance. In addition, user??s interest is easily affected by short-term environment and mood. This paper proposes a recommendation model that is a multi-task feature learning approach for knowledge graph and short-term preferences enhanced recommendation (MKASR) in response to the above two points. Firstly, the RippleNet algorithm is used to extract the relationship pairs between the user and the knowledge graph entity, and then these relationship pairs are stored in the form of knowledge graph triples for participating in training. The bidirectional GRU (gate recurrent unit) network based on the attention mechanism is adopted from the user??s recent interaction sequence of items to extract the user??s short-term preferences. Secondly, this paper uses the multi-task learning method to train the knowledge graph learning module and the recommendation module. And the feature representation between user and item can be obtained. Finally, these feature representations and the short-term preferences of users are taken into account to make comprehensive recommendations to users. The experiments on real MovieLens-1M and Book-Crossing datasets demonstrate that the proposed model has improved performance compared with other recommendation algorithms in AUC, ACC, Precision and Recall evaluation indexes.

Key words: recommender systems, knowledge graph, short-term preferences, preference propagation, multi-task learning

摘要：

近年来，将知识图谱作为辅助信息来增强推荐越来越受到研究者的关注。由于知识图谱学习任务的目标是还原知识图谱中三元组的关系，并非是以推荐任务为目标，导致了知识图谱学习任务很难高效地帮助推荐任务提升推荐性能。另外，用户兴趣易被短期的环境和心情所影响。针对以上两点，提出了一种融合了知识图谱信息和短期偏好的推荐模型（MKASR）。首先，通过RippleNet算法提取用户和知识图谱实体的关系对，然后将这些关系对按照知识图谱三元组的形式存储和参与训练；采用基于注意力机制的双向GRU网络从用户近期交互的物品序列中提取用户的短期偏好；其次，采用多任务学习的方法同时训练知识图谱学习模块和推荐模块，并得到用户和物品的特征表示；最后，通过这些特征表示和用户的短期偏好向用户综合推荐。在真实数据集MovieLens-1M和Book-Crossing上进行实验，采用AUC、ACC、Precision和Recall指标进行评估，实验结果表明，提出的模型优于其他的基准模型。

关键词: 推荐系统, 知识图谱, 短期偏好, 偏好传播, 多任务学习

GAO Yang, LIU Yuan. Recommendation Algorithm Combining Knowledge Graph and Short-Term Preferences[J]. Journal of Frontiers of Computer Science and Technology, 2021, 15(6): 1133-1144.

高仰, 刘渊. 融合知识图谱和短期偏好的推荐算法[J]. 计算机科学与探索, 2021, 15(6): 1133-1144.

References

[1] LUO Y, XIA H B, LIU Y. Collaborative filtering based on attention LSTM[J]. Journal of Chinese Information Processing, 2019, 33(12): 110-118.
罗洋, 夏鸿斌, 刘渊. 融合注意力LSTM的协同过滤推荐算法[J]. 中文信息学报, 2019, 33(12): 110-118.
[2] HUANG L W, JIANG B T, LV S Y, et al. Survey on deep learning based recommender systems[J]. Chinese Journal of Computers, 2018, 41(7): 1619-1647.
黄立威, 江碧涛, 吕守业, 等. 基于深度学习的推荐系统研究综述[J]. 计算机学报, 2018, 41(7): 1619-1647.
[3] MOONEY R J, ROY L. Content-based book recommend-ing using learning for text categorization[C]//Proceedings of the 5th ACM Conference on Digital Libraries, San Antonio, Jun 2-7, 2000. New York: ACM, 2000: 195-204.
[4] GOLDBERG D, NICHOLS D, OKI B M, et al. Using colla-borative filtering to weave an information tapestry[J]. Commu-nications of the ACM, 1992, 35(12): 61-70.
[5] MARKO B, YOAV S. Fab: content-based, collaborative reco-mmendation[J]. Communications of the ACM, 1997, 40(3): 66-72.
[6] ZHANG S, YAO L, SUN A, et al. Deep learning based recom-mender system: a survey and new perspectives[J]. ACM Computing Surveys, 2019, 52(1): 1-38.
[7] CHEN X, XU H, ZHANG Y, et al. Sequential recommenda-tion with user memory networks[C]//Proceedings of the 11th ACM International Conference on Web Search and Data Mining, Marina Del Rey, Feb 5-9, 2018. New York: ACM, 2018: 108-116.
[8] HAN J Y, ZHENG L H, HUANG H, et al. Deep latent factor model with hierarchical similarity measure for recommender systems[J]. Information Sciences: An International Journal, 2019, 503: 521-532.
[9] KOREN Y, BELL R, VOLINSKY C. Matrix factorization techniques for recommender systems[J]. Computer, 2009, 42(8): 30-37.
[10] CHENG H T, KOC L, HARMSEN J, et al. Wide & deep learning for recommender systems[C]//Proceedings of the 1st Workshop on Deep Learning for Recommender Systems, Boston, Sep 15, 2016. New York: ACM, 2016: 7-10.
[11] LI Y, LIU T, JIANG J, et al. Hashtag recommendation with topical attention-based LSTM[C]//Proceedings of the 26th International Conference on Computational Linguistics, Osaka, Dec 11-16, 2016. Stroudsburg: ACL, 2016: 3019-3029.
[12] HIDASI B, KARATZOGLOU A, BALTRUNAS L, et al. Session-based recommendations with recurrent neural networks [C]//Proceedings of the 4th International Conference on Learning Representations, San Juan, May 2-4, 2016: 1-9.
[13] BANSAL T, BELANGER D, MCCALLUM A. Ask the GRU: multi-task learning for deep text recommendations[C]//Pro-ceedings of the 10th ACM Conference on Recommender Systems, Boston, Sep 15-19, 2016. New York: ACM, 2016: 107-114.
[14] WANG X, WANG D X, XU C R, et al. Explainable rea-soning over knowledge graphs for recommendation[C]//Proceedings of the 33rd AAAI Conference on Artificial Intelligence, the 31st Innovative Applications of Artificial Intelligence Conference, the 9th AAAI Symposium on Edu-cational Advances in Artificial Intelligence, Honolulu, Jan 27-Feb 1, 2019. Menlo Park: AAAI, 2019: 5329-5336.
[15] SUN Z, YANG J, ZHANG J, et al. Recurrent knowledge graph embedding for effective recommendation[C]//Procee-dings of the 12th ACM Conference on Recommender Systems, Vancouver, Oct 2-7, 2018. New York: ACM, 2018: 297-305.
[16] ZHAO H, YAO Q M, LI J D, et al. Meta-graph based recom-mendation fusion over heterogeneous information networks[C]//Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, Aug 13-17, 2017. New York: ACM, 2017: 635-644.
[17] WANG Q, MAO Z, WANG B, et al. Knowledge graph embe-dding: a survey of approaches and applications[J]. IEEE Transactions on Knowledge & Data Engineering, 2017, 29(12): 2724-2743.
[18] BORDES A, USUNIER N, GARCíA-DURáN A, et al. Trans-lating embeddings for modeling multi-relational data[C]//Proceedings of the 26th International Conference on Neural Information Processing Systems, Lake Tahoe, Dec 5-8, 2013. Red Hook: Curran Associates, 2013: 2787-2795.
[19] LUO A G, GAO S, XU Y J. Deep semantic match model for entity linking using knowledge graph and text[C]//Pro-ceedings of the 2017 International Conference on Identi-fication, Information and Knowledge in the Internet of Things, Shandong, Oct 19-21, 2017. New York: Elsevier Science Inc., 2017: 110-114.
[20] WANG H W, ZHANG F Z, XIE X, et al. DKN: deep knowledge-aware network for news recommendation[C]//Proceedings of the 2018 World Wide Web Conference, Lyon, Apr 23-27, 2018. New York: ACM, 2018: 1835-1844.
[21] WANG H W, ZHANG F Z, WANG J L, et al. RippleNet: pro-pagating user preferences on the knowledge graph for reco-mmender systems[C]//Proceedings of the 27th ACM Interna-tional Conference on Information and Knowledge Management, Torino, Oct 22-26, 2018. New York: ACM, 2018: 417-426.
[22] WANG H W, ZHANG F Z, ZHAO M, et al. Multi-task feature learning for knowledge graph enhanced recommendation [C]//Proceedings of the 2019 World Wide Web Conference, San Francisco, May 13-17, 2019. New York: ACM, 2019: 2000-2010.
[23] KOREN Y. Factorization meets the neighborhood: a multifaceted collaborative filtering model[C]//Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Dis-covery and Data Mining, Las Vegas, Aug 24-27, 2008. New York: ACM, 2008: 426-434.
[24] GOIN J E. Classification bias of the k-nearest neighbor algo-rithm[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1984, 6(3): 379-381.
[25] WANG H W, ZHANG F Z, ZHANG M D, et al. Knowledge-aware graph neural networks with label smoothness regula-rization for recommender systems[C]//Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Anchorage, Aug 4-8, 2019. New York: ACM, 2019: 968-977.
[26] WANG H W, ZHAO M, XIE X, et al. Knowledge graph convolutional networks for recommender systems[C]//Procee-dings of the 2019 World Wide Web Conference, San Francisco, May 13-17, 2019. New York: ACM, 2019: 3307-3313.