聚集度指标引导的注意力学习粒子群优化算法

doi:10.3778/j.issn.1673-9418.2201044

摘要/Abstract

摘要： 尽管目前粒子群优化（PSO）算法在求解很多优化问题上表现出了良好的性能，但如何在保持种群多样性的同时确保收敛精度，防止群体陷入局部最优，平衡勘探与开发之间的矛盾，仍是粒子群优化算法研究需要解决的问题。针对这些问题，提出了一种聚集度指标引导的注意力学习粒子群优化算法（ALPSO-AI）。首先，为了有效保持种群多样性，整个种群被分成若干大小相等的子群，并且在进化过程中重新组合，在每一代中，子群中的不同粒子根据其性能自适应地选择多个优质的学习对象。种群外部设有存档，用于指导种群的搜索并评估进化程度；其次，引入注意力机制，根据每个学习对象与更新粒子适应值的差异，对每个学习对象赋予不同的注意力权重，生成一个高质量的学习榜样，用于粒子的更新。针对搜索前期和后期不同的搜索需求，分别设计不同尺度的注意力分配方式，进行全局搜索和局部搜索；此外，对存档引入聚集度指标，通过判断当前最优粒子周围的适应值相似度，评估当前种群进化水平，当聚集度指标达到阈值时，开启局部搜索，以增强算法的整体收敛能力。实验对CEC2013测试集的28个基准函数在30维和50维的空间分别进行测试，并与主流的5种变体PSO和其他优化算法进行比较，实验结果证明了ALPSO-AI的优越性。此外，注意力学习和聚集度指标的有效性也进行了充分的验证。

关键词: 粒子群优化（PSO）, 注意力机制, 聚集度指标, 存档, 局部搜索

Abstract: Although the particle swarm optimization (PSO) algorithm has demonstrated good performance in solving many optimization problems, maintaining population diversity while ensuring convergence accuracy, preventing the swarm from getting trapped in local optima, and balancing exploration and exploitation remain important research problems for PSO algorithms. In response to these issues, this paper proposes an attention learning particle swarm optimization algorithm guided by aggregation indicator (ALPSO-AI). Firstly, to effectively maintain population diversity, the entire population is divided into equally sized subswarms, which are recombined during the evolution process. In each generation, different particles in the subswarms adaptively select multiple high-quality learning objects based on their performance. An external archive is established to guide the search and evaluate the evolutionary progress of the population. Secondly, an attention mechanism is introduced to assign different attention weights to each learning object based on the difference between its performance and the updated particle??s fitness value. Thus, a high-quality learning prototype is generated for particle updates. Different scales of attention allocation methods are designed to meet the diverse search requirements in the early and late stages of the search process, enabling both global and local search capabilities. Furthermore, an aggregation indicator is introduced to the archive, which assesses the current population??s evolutionary level by examining the similarity of fitness values around the current best particle. When the aggregation indicator reaches a threshold, local search is initiated to enhance the overall convergence capability of the algorithm. Experimental evaluations are conducted on the 28 benchmark functions from the CEC2013 test suite in both 30 and 50 dimensions. ALPSO-AI is compared with five popular PSO variants and other optimization algorithms. Experimental results confirm the superiority of ALPSO-AI. The effectiveness of attention learning and the aggregation indicator is also thoroughly validated.

Key words: particle swarm optimization (PSO), attention mechanism, aggregation indicator, archive, local search

赵晓妍, 宋威. 聚集度指标引导的注意力学习粒子群优化算法[J]. 计算机科学与探索, 2023, 17(8): 1852-1866.

ZHAO Xiaoyan, SONG Wei. Attention Learning Particle Swarm Optimization Algorithm Guided by Aggrega-tion Indicator[J]. Journal of Frontiers of Computer Science and Technology, 2023, 17(8): 1852-1866.

参考文献

[1] KENNEDY J, EBERHART R C. Particle swarm optimization[C]//Proceedings of the 1995 IEEE International Conference on Neural Network, Perth, Nov 27-Dec 1, 1995. Piscataway: IEEE, 1995: 1942-1948.
[2] 张海月, 秦永彬, 许道云. 求解FFS问题的混合搜索机制粒子群算法[J]. 计算机科学与探索, 2016, 10(3): 433-444.
ZHANG H Y, QIN Y B, XU D Y. Multi-search mechanism particle swarm optimization algorithm for solving FFS pro-blem[J]. Journal of Frontiers of Computer Science and Tech-nology, 2016, 10(3): 433-444.
[3] 胡晓敏, 王明丰, 张首荣, 等. 用于文本聚类的新型差分进化粒子群算法[J]. 计算机工程与应用, 2021, 57(4): 61-67.
HU X M, WANG M F, ZHANG S R, et al. New differential evolution with particle swarm optimization algorithm for text clustering[J]. Computer Engineering and Applications, 2021, 57(4): 61-67.
[4] ABBAS G, GU J, FAROOQ U, et al. Solution of an economic dispatch problem through particle swarm optimization: a detailed survey-part I[J]. IEEE Access, 2017, 5: 15105-15141.
[5] QIN C, YAN Q Y, HE G. Integrated energy systems planning with electricity, heat and gas using particle swarm optimiza-tion[J]. Energy, 2019, 188: 116044.
[6] 朱佳莹, 高茂庭. 融合粒子群与改进蚁群算法的AUV路径规划算法[J]. 计算机工程与应用, 2021, 57(6): 267-273.
ZHU J Y, GAO M T. AUV path planning based on particle swarm optimization and improved ant colony optimization[J]. Computer Engineering and Applications, 2021, 57(6): 267-273.
[7] NGUYEN B H, XUE B, ANDREAE P, et al. A new binary particle swarm optimization approach: momentum and dyna-mic balance between exploration and exploitation[J]. IEEE Transactions on Cybernetics, 2021, 51(2): 589-603.
[8] LIANG J J, QIN A K, SUGANTHAN P N, et al. Compre-hensive learning particle swarm optimizer for global optimi-zation of multimodal functions[J]. IEEE Transactions on Evolutionary Computation, 2006, 10(3): 281-295.
[9] DONG W Y, ZHOU M C. A supervised learning and control method to improve particle swarm optimization algorithms[J]. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2017, 47(7): 1135-1148.
[10] YANG Q, CHEN W N, GU T L, et al. Segment-based pre-dominant learning swarm optimizer for large-scale optimi-zation[J]. IEEE Transactions on Cybernetics, 2017, 47(9): 2896-2910.
[11] 纪伟, 李英梅, 季伟东, 等. 粒子置换的双种群综合学习PSO算法[J]. 计算机科学与探索, 2021, 15(4): 766-776.
JI W, LI Y M, JI W D, et al. Two-population comprehen-sive learning PSO algorithm based on particle permutation[J]. Journal of Frontiers of Computer Science and Techno-logy, 2021, 15(4): 766-776.
[12] LIU W, WANG Z, YUAN Y N. et al. A novel sigmoid-function-based adaptive weighted particle swarm optimizer[J]. IEEE Transactions on Cybernetics, 2021, 51(2): 1085-1093.
[13] WANG Z J, ZHAN Z H, KWONG S, et al. Adaptive granu-larity learning distributed particle swarm optimization for large-scale optimization[J]. IEEE Transactions on Cybernetics, 2021, 51(3): 1175-1188.
[14] ZHU G P, KWONG S. Gbest-guided artificial bee colony algorithm for numerical function optimization[J]. Applied Mathematics & Computation, 2010, 217(7): 3166-3173.
[15] HOUSSEIN E H, GAD A G, HUSSAIN K, et al. Major advances in particle swarm optimization: theory, analysis, and application[J]. Swarm and Evolutionary Computation, 2021, 63: 100868.
[16] 张晗, 杨继斌, 张继业, 等. 基于多种群萤火虫算法的车载燃料电池直流微电网能量管理优化[J]. 中国电机工程学报, 2021, 41(3):13-19.
ZHANG H, YANG J B, ZHANG J Y, et al. Multiple-population firefly algorithm-based energy management stra-tegy for vehicle-mounted fuel cell DC microgrid[J]. Procee-dings of the CSEE, 2021, 41(3): 13-19.
[17] ZHANG J Q, SANDERSON A C. JADE: a daptive differential evolution with optional external archive[J]. IEEE Transactions on Evolutionary Computation, 2009, 13(5): 945-958.
[18] YANG Q, CHEN W N, GU T L, et al. A distributed swarm optimizer with adaptive communication for large-scale opti-mization[J]. IEEE Transactions on Cybernetics, 2020, 50(7): 3393-3408.
[19] ZHU X Y, GUO K H, REN S, et al. Lightweight image super-resolution with expectation-maximization attention mechanism[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2022, 32(3): 1273-1284.
[20] 宋威, 华子彧. 融入社会影响力的粒子群优化算法[J]. 计算机科学与探索, 2020, 14(11): 1908-1919.
SONG W, HUA Z Y. Particle swarm optimization with social influence[J]. Journal of Frontiers of Computer Science and Technology, 2020, 14(11): 1908-1919.
[21] DENG H B, PENG L Z, ZHANG H B, et al. Ranking-based biased learning swarm optimizer for large-scale optimization[J]. Information Sciences, 2019, 493:120-137.
[22] 吕振肃, 侯志荣. 自适应变异的粒子群优化算法[J]. 电子学报, 2004, 32(3): 416-420.
LV Z S, HOU Z R. Particle swarm optimization with adap-tive mutation[J]. Acta Electronica Sinica, 2004, 32(3): 416-420.
[23] XIA X W, XING Y, WEI B, et al. A fitness-based multi-role particle swarm optimization[J]. Swarm and Evolutionary Computation, 2019, 44: 349-364.
[24] VAFASHOAR R, MORSHEDLOU H, MEYBODI M R. Bifurcated particle swarm optimizer with topology learning particles[J]. Applied Soft Computing, 2022, 114: 108039.
[25] CAO Y L, ZHANG H, LI W F, et al. Comprehensive lear-ning particle swarm optimization algorithm with local search for multimodal functions[J]. IEEE Transactions on Evolu-tionary Computation, 2019, 23(4): 718-731.
[26] LIN A P, SUN W, YU H S, et al. Adaptive comprehensive learning particle swarm optimization with cooperative arc-hive[J]. Applied Soft Computing Journal, 2019, 77: 533-546.
[27] XIA X W, GUI L, YU F, et al. Triple archives particle swarm optimization[J]. IEEE Transactions on Cybernetics, 2020, 50(12): 4862-4875.
[28] LYNN N, SUGANTHAN P N. Ensemble particle swarm optimizer[J]. Applied Soft Computing, 2017, 55: 533-548.
[29] DERRAC J, GARCIA S, MOLINA D, et al. A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelli-gence algorithms[J]. Swarm & Evolutionary Computation, 2011, 1(1): 3-18.
[30] 方柳平, 汪继文, 邱剑锋, 等. 具有学习因子的动态搜索烟花算法[J]. 计算机科学与探索, 2017, 11(3): 491-501.
FANG L P, WANG J W, QIU J F, et al. Dynamic search fireworks algorithm with learning factor[J]. Journal of Fron-tiers of Computer Science and Technology, 2017, 11(3): 491-501.
[31] ZHOU X Z, LU J X, HUANG J H, et al. Enhancing arti-ficial bee colony algorithm with multi-elite guidance[J]. Infor-mation Sciences, 2021, 543: 242-258.
[32] PENG H, ZENG Z, DENG C, et al. Multi-strategy serial cuckoo search algorithm for global optimization[J]. Knowledge-Based Systems, 2021, 214: 106729.