Journal of Frontiers of Computer Science and Technology ›› 2022, Vol. 16 ›› Issue (6): 1429-1438.DOI: 10.3778/j.issn.1673-9418.2011010

• Graphics and Image • Previous Articles    

Multi-discriminator Generative Adversarial Networks Based on Selective Ensemble Learning

SHEN Ruicai1,2, ZHAI Junhai1,2,+(), HOU Yingzhen1,2   

  1. 1. College of Mathematics and Information Science, Hebei University, Baoding, Hebei 071002, China
    2. Hebei Key Laboratory of Machine Learning and Computational Intelligence, Hebei University, Baoding, Hebei 071002, China
  • Received:2020-11-04 Revised:2021-01-05 Online:2022-06-01 Published:2021-01-28
  • About author:SHEN Ruicai, born in 1993, M.S. candidate. Her research interest is deep learning.
    ZHAI Junhai, born in 1964, Ph.D., professor. His research interests include machine learning, deep learning and big data processing.
    HOU Yingzhen, born in 1995, M.S. candidate. Her research interest is deep learning.
  • Supported by:
    Key Research and Development Project of Hebei Provincial Science and Technology Plan(19210310D);Natural Science Foundation of Hebei Province(F2021201020)

选择性集成学习多判别器生成对抗网络

申瑞彩1,2, 翟俊海1,2,+(), 侯璎真1,2   

  1. 1. 河北大学 数学与信息科学学院,河北 保定 071002
    2. 河北大学 河北省机器学习与计算智能重点实验室,河北 保定 071002
  • 通讯作者: + E-mail: mczjh@126.com
  • 作者简介:申瑞彩(1993—),女,河北邯郸人,硕士研究生,主要研究方向为深度学习。
    翟俊海(1964—),男,河北易县人,博士,教授,主要研究方向为机器学习、深度学习、大数据处理。
    侯璎真(1995—),女,河北唐山人,硕士研究生,主要研究方向为深度学习。
  • 基金资助:
    河北省科技计划重点研发项目(19210310D);河北省自然科学基金(F2021201020)

Abstract:

Generative adversarial networks (GAN) are widely used in image generation. However, there is still a big gap between the samples generated by unsupervised and supervised networks. In order to solve the problems such as poor diversity, low quality and long training time of GAN in unsupervised environment, a new model with selective ensemble learning is proposed. Specifically, the discriminator in GAN is adopted in the form of integrated discrimination system, which can effectively reduce the discrimination error caused by the poor performance of single discriminator. Considering that if the integrated discriminant networks are set up in a unified network, each base discriminant network will tend to a form of expression in the model training. In order to encourage the diversity of discriminant network results and avoid the network falling into the same one, the discriminant networks with different network structures are set up. The majority voting strategy with dynamically adjusting the voting weight of the base discriminant network is introduced to vote the results of the integrated discriminant network. This has been shown to be effective in promoting model convergence and reducing experimental error significantly. Finally, the proposed model and the models in the same direction are evaluated with different evaluation indices under different datasets. Experimental results show that the proposed model is superior to several competitive models in terms of the diversity of generated samples, the quality of generated samples and the convergence speed of the model.

Key words: generative adversarial networks (GAN), integrated discrimination system, selective ensemble learning, majority voting strategy

摘要:

生成对抗网络(GAN)在图像生成方面具有广泛应用,但基于无监督方式与有监督方式的网络生成样本仍有较大差距。为解决生成对抗网络在无监督环境中生成样本多样性差、质量较低以及模型训练时间过长等问题,提出了具有选择性集成学习思想的生成对抗网络模型。将生成对抗网络中的判别网络采用集成判别系统的形式,有效减少了由单判别器判别性能不佳导致判别误差的情况;同时考虑到若集成判别网络均采用统一网络设置,则在模型训练中基判别网络将趋近于一种表现形式,为鼓励判别网络判别结果多样且避免网络陷入雷同,设置拥有不同网络结构的判别网络,并在集成判别网络中引入具有动态调整基判别网络投票权重的多数投票策略,对集成判别网络的判别结果进行投票,有效地促进了模型的收敛且较大减少了实验误差。最后将提出的模型与同方向的模型在不同数据集上使用不同评价指标进行评价,实验结果表明提出的模型无论在生成样本多样性、生成样本质量还是在模型收敛速度上均明显优于几种竞争模型。

关键词: 生成对抗网络(GAN), 集成判别系统, 选择性集成学习, 多数投票策略

CLC Number: