Journal of Frontiers of Computer Science and Technology ›› 2012, Vol. 6 ›› Issue (12): 1109-1115.DOI: 10.3778/j.issn.1673-9418.2012.12.005

Previous Articles     Next Articles

Sign Language Gesture Driven Head Movement Synthesis

HE Wenjing1,2,3+, CHEN Yiqiang1,2, LIU Junfa1,2   

  1. 1. Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China
    2. Beijing Key Laboratory of Mobile Computing and Pervasive Device, Beijing 100190, China
    3. University of Chinese Academy of Sciences, Beijing 100049, China
  • Online:2012-12-01 Published:2012-12-03

手势数据驱动的头部运动合成方法

何文静1,2,3+,陈益强1,2,刘军发1,2   

  1. 1. 中国科学院 计算技术研究所,北京 100190
    2. 移动计算与新型终端北京市重点实验室,北京 100190
    3. 中国科学院大学,北京 100049

Abstract: Non-manual component plays an important role in sign language communication. Head movement synthesis and synchronization with gesture is one of those main topics. Based on realistic training data, this paper introduces detailed explorations to reveal the relationship between gesture and head motion, and uses kernel canonical correlation analysis (KCCA) to build the head movement prediction model. Animation synthesis results and evaluation experiments imply that the proposed method can better measure the cooperation between sign gesture and head motion and enhance the naturalness of synthesized behaviors of sign language virtual human.

Key words: sign language, non-manual component, head movement, kernel canonical correlation analysis (KCCA), virtual human

摘要: 非手部手势是手语表达中不可缺少的一部分,头部运动的实现并与手势进行协同表达是其重要研究内容。对真人手语表演数据中的手势与头部动作之间的关系进行了深入研究,提取二者的动作特征,利用核典型相关分析方法(kernel canonical correlation analysis,KCCA)建立起手势与头部动作之间的预测关系模型。动画合成结果以及评价实验表明,KCCA方法能更好地刻画手势与头部动作的协调性,实现虚拟人行为动作合成的逼真性。

关键词: 手语, 非手部手势, 头部动作, 核典型相关分析, 虚拟人