关键词: 强化学习, 异构, 反馈信号, 视觉听觉相干性

Abstract: This paper explores whether the synergy of visual and audio signals can improve people’s memory and reasoning ability in the model of reinforcement learning of game-based rescue professional training system for highly dangerous professions. Then, it proposes a hierarchy reinforcement learning frame and algorithm of collaborative multi-agent system using semi-Markov game (SMG) model, which is a heterogeneous multi-agent system including visual process agent, audio process agent and human agent. Investigating the constitution of those application models, analyzing and generalizing the properties and characteristics of feedback signals for audio-visual coherency are very challenging tasks, which will decide the integrating way and means of the reinforcement heterogeneous signals. On the basis of previous analyses, the paper studies the bias algorithm for integrating heterogeneous feedback signals, and the result greatly reduces the retrieval state space, alleviates the curse of dimensional problem. According to principles of “systematic desensitization psychotherapy”, the paper designs a mood-personality-stimulus-regulation (MPSR) model and a personalized rendering algorithm for terrorist scene (PRATS) in order to improve the psychological quality of trainees. The relevant experimental results prove the validity of these model and algorithms.

Key words: reinforcement learning, heterogeneous, feedback signal, audio-visual coherency