关键词: 人机交互, 非接触式操作, 手势识别, Kinect, 机器学习

Abstract: People are gradually abandoning the mouse and keyboard since touch screens come into their lives, however the shortcomings and limitations of touch manipulation emerge subsequently, thus non-contact manipulations are becoming the new trend of human-computer interaction in the future due to its unique advantages. There are many problems in existing non-contact manipulation approaches, e.g. improper definitions of gestures, complex algorithms, low recognition accuracy, etc. This paper proposes RemoteControl, a non-contact manipulation approach based on machine learning and the Kinect device. Users can finish most fundamental GUI (graphical user interface) manipulations in the 3-dimensional space by the two actions, “grab” and “put”. RemoteControl utilizes SVM (support vector machine) and random forest to recognize hand shapes in hand images. The experimental results show that RemoteControl achieves high accuracy in hand gesture recognition.

Key words: human-computer interaction, non-contact manipulation, gesture recognition, Kinect, machine learning