计算机科学与探索 ›› 2020, Vol. 14 ›› Issue (8): 1261-1274.DOI: 10.3778/j.issn.1673-9418.2002020

• 综述·探索 • 上一篇    下一篇

面向迁移学习的意图识别研究进展

赵鹏飞,李艳玲,林民   

  1. 内蒙古师范大学 计算机科学技术学院,呼和浩特 010022
  • 出版日期:2020-08-01 发布日期:2020-08-07

Research Progress on Intent Detection Oriented to Transfer Learning

ZHAO Pengfei, LI Yanling, LIN Min   

  1. College of Computer Science and Technology, Inner Mongolia Normal University, Hohhot 010022, China
  • Online:2020-08-01 Published:2020-08-07

摘要:

口语理解(SLU)是人机对话系统的重要部分,意图识别作为口语理解的一个子任务,因其可以为限定领域的对话扩展领域而处于非常重要的地位。由于实际应用领域的对话系统需求增加,而需要开发的新领域短时间内又无法获得大量数据,因此为搭建新领域的深度学习模型提出了挑战。迁移学习是深度学习的一种特殊应用,在迁移学习中,能够利用源域和目标域完成对只有少量标注数据的目标域模型的构建,通过对源域和目标域之间的知识迁移完成学习过程。利用已有领域的标注数据和模型,搭建只含有少量标注数据的新领域对话系统是当前的研究重点。主要针对意图识别任务进行概述,对迁移学习的方法进行分类和阐述,并总结其问题和解决思路,进一步思考如何将迁移学习应用于意图识别任务,从而推动少量数据的新领域意图识别研究。

关键词: 口语理解, 意图识别, 深度学习, 迁移学习

Abstract:

Spoken language understanding (SLU) is an important part of human-machine dialogue system. Intent detection is an important sub-task in SLU, because it can expand the fields of dialogue in a limited field. Due to the increase in the demand for dialogue systems in practical application fields, and the new fields that need to be developed cannot obtain a large amount of data in a short time, it poses challenges for building deep learning models in new fields. Transfer learning is a special application of deep learning. In transfer learning, the source and target domains can be used to complete the construction of a target domain model with only a small amount of labeled data. The learning process is completed by transferring knowledge between the source and target domains. Based on labeled data and models in existing fields, building a new dialogue system with only a small amount of labeled data is a current research focus. This paper summarizes the task of intent detection, classifies and elaborates transfer learning methods, and summarizes their problems and solutions. This paper further thinks about how to apply transfer learning to the intent detection task, so as to promote a new field of intent detection research with a small amount of data.

Key words: spoken language understanding, intent detection, deep learning, transfer learning