计算机科学与探索 ›› 2024, Vol. 18 ›› Issue (2): 465-476.DOI: 10.3778/j.issn.1673-9418.2210096

• 图形·图像 • 上一篇    下一篇

融合中式元素的三维室内场景情绪化渲染

盛家川,胡国林,李玉芝   

  1. 天津财经大学 理工学院,天津 300222
  • 出版日期:2024-02-01 发布日期:2024-02-01

Emotional Rendering of 3D Indoor Scene with Chinese Elements

SHENG Jiachuan, HU Guolin, LI Yuzhi   

  1. School of Science and Technology, Tianjin University of Finance and Economics, Tianjin 300222, China
  • Online:2024-02-01 Published:2024-02-01

摘要: 情绪具有主观性,利用计算机技术自动生成一个既满足真实性又与目标情绪匹配的虚拟室内场景是一项充满挑战的任务。目前缺乏对室内场景情感表达进行识别和评估的技术方法,且在充分考虑情感诉求的前提下,如何提升场景渲染结果真实性也是室内场景设计需要考虑的重要因素。针对上述问题,提出了一种融合中式元素的虚拟室内场景情绪化渲染算法。首先,利用深度学习算法从一个包含25 000张图片的家庭室内场景数据集中提取不同情绪的特征,训练情绪分类器,用于识别和评估渲染过程中虚拟室内场景的情绪表达。其次,为了保证渲染结果真实性,设计了一种场景物体纹理颜色真实性度量算法。然后,研究了根据目标情绪自动渲染虚拟室内场景的优化算法、融合中式元素的风格迁移算法,对场景中的物体进行细粒度的中式风格化处理,提升渲染结果的空间内涵、文化底蕴以及情感表达,增强视觉感染力。最后,在四个不同的室内场景中对该算法进行了实验,并通过对实验结果和用户调研数据的统计分析验证了该算法的正确性和有效性。

关键词: 虚拟现实, 情感建模, 中式元素, 风格迁移

Abstract: One of the challenging tasks is to use computer technology to automatically design a virtual indoor scene that both satisfies realness and matches the target emotion. The subjective nature of emotions brings uncertainty of results. At present, there is a lack of approach to identify and evaluate emotion of indoor scenes. In addition, under the premise of fully considering emotional appeals, the authenticity of scene is also one of important factors in indoor scene design. Aiming at above problems, a novel optimization algorithm combining Chinese elements for indoor scenes rendering is proposed. Firstly, an emotion classifier is trained to identify and evaluate the emotion with the features extracted via deep learning from a indoor scene dataset containing 25000 images. Secondly, in order to ensure the authenticity of rendering results, an algorithm is proposed to evaluate how realistic the colors of the objects’ textures. Next, an algorithm is designed to render indoor scene automatically according to the target emotion. Then, a style transfer algorithm integrating with Chinese elements is used to carry out fine-grained refinement processing on the furnishings in an indoor scene, improve the spatial connotation, cultural connotation and emotional expression of rendering results, and enhance the visual appeal. Finally, the approach is tested in four indoor scenes, and the correctness and effectiveness of the approach are verified through statistical analysis of results and user survey data.

Key words: virtual reality, affective modeling;?Chinese elements, style transfer