Granular Support Vector Machine Algorithm Based on Affinity Propagation

doi:10.3778/j.issn.1673-9418.1905073

Abstract

Abstract:

The granular support vector machine (GSVM) can effectively improve the learning efficiency of support vector machine (SVM) but may lose some generalization ability at same time, because it is sensitive to the initial granulation parameter and the selection of granular centers is rough. This paper proposes a new granular support vector machine model, called affinity propagation based granular support vector machine (APG_SVM). Firstly，a group of high-quality and more representative granular centers are selected to join the training dataset using affinity propagation. And then the training dataset is optimized according to the mixing degree of sample in the granular and the distance between the granular centers and hyperplane. The final training dataset is generated, and the generalization performance of GSVM can be improved by training on the final dataset. The experimental results on UCI standard datasets show that compared with traditional GSVM, the classification efficiency of this algorithm is obviously improved, the accuracy on several datasets is relatively stable, and the classification performance is better.

Key words: granular center, affinity propagation, mixing degree, classification performance

摘要：

传统粒度支持向量机（GSVM）模型可以有效提高支持向量机（SVM）的学习效率，但因其对初始粒划参数比较敏感，粒中心的选取比较粗糙，会损失一定的泛化能力。提出一种基于近邻传输的粒度支持向量机学习算法（APG_SVM）。首先在训练数据上采用近邻传输思想选取一组高质量的更具有代表性的粒中心加入到训练集，再根据粒中样本的混合度及粒中心到超平面的距离对训练集进行优化，生成最终训练集，然后进行训练，这样可使GSVM具有更好的泛化能力。在UCI标准数据集上的实验结果表明，与传统的粒度支持向量机相比，该算法分类效率有明显提高，在几个数据集上的正确率相对稳定，获得了较好的分类性能。

关键词: 粒中心, 近邻传输, 混合度, 分类性能

CHENG Fengwei, WANG Wenjian. Granular Support Vector Machine Algorithm Based on Affinity Propagation[J]. Journal of Frontiers of Computer Science and Technology, 2020, 14(7): 1194-1199.

程凤伟，王文剑. 基于近邻传输的粒度SVM算法[J]. 计算机科学与探索, 2020, 14(7): 1194-1199.

References

[1] Zhou Z H. Machine learning[M]. Beijing: Tsinghua University Press, 2016. 周志华. 机器学习[M]. 北京: 清华大学出版社, 2016.
[2] Johan S, Joos V. Least squares support vector machine classi-fiers[J]. Neural Processing Letters, 1999, 3: 293-300.
[3] Edgar O, Robert F, Federico G. Training support vector machines: an application to face detection[C]//Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition, San Juan, Jun 17-19, 1997. Washington: IEEE Computer Society, 1997: 130-136.
[4] Sayan M, Edgar O, Federico G. Nonlinear prediction of chaotic time series using a support vector machine[C]//Proceedings of the 1997 IEEE Workshop on Neural Networks for Signal Processing, Amelia Island, Sep 24-26, 1997. Piscataway: IEEE, 1997: 1125-1132.
[5] Tang Y C, Jin B, Zhang Y Q. Granular support vector machines for medical binary classification problems[C]//Proceedings of the 2004 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, La Jolla, Oct 7-8, 2004. Piscataway: IEEE, 2004: 73-78.
[6] Guo H S, Wang W J, Men C Q. A novel learning model-kernel granular support vector machine[C]//Proceedings of the 2009 International Conference on Machine Learning and Cybernetics, Baoding, Jul 12-15, 2009. Piscataway: IEEE, 2009: 930-935.
[7] Tang Y C, Jin B, Zhang Y Q. Granular support vector machines with association rules mining for protein homology prediction[J]. Artificial Intelligence in Medicine, 2005, 35(1): 121-134.
[8] Pang S N, Kasabov N. Discovering the knowledge of association rule over SVM classification trees[C]//Proceedings of the 2008 International Joint Conference on Neural Networks, Part of the IEEE World Congress on Computational Intelligence, Hong Kong, China, Jun 1-6, 2008. Piscataway: IEEE, 2008: 2486-2493.
[9] Stahl D, Pickles A, Elsabbagh M, et al. Novel machine lear-ning methods for ERP analysis: a validation from research on infants at risk for autism[J]. Developmental Neuropsychology, 2012, 37(3): 274-298.
[10] Liang J Y, Bai L, Cao F Y. K-Modes clustering algorithm based on a new distance measure[J]. Journal of Computer Research and Development, 2010, 47(10): 1749-1755. 梁吉业, 白亮, 曹付元. 基于新的距离度量的K-Modes聚类算法[J]. 计算机研究与发展, 2010, 47(10): 1749-1755.
[11] Wu D H, Wang Z L, Chen Y, et al. Mixed-kernel based weighted extreme learning machine for inertial sensor based human activity recognition with imbalanced dataset[J]. Neurocomputing, 2015, 11: 1-15.
[12] Arun K M, Gopal M. A hybrid SVM based decision tree[J]. Pattern Recognition, 2010, 43(12): 3977-3987.
[13] Chen R C, Cheng K F, Hsieh C F. Using rough set and support vector machine for network intrusion detection system[J]. International Journal of Network Security & Its Applications, 2009, 59(2): 465-470.
[14] Zhang Z W, Wang Z Y. Mining overlapping and hierarchical communities in complex networks[J]. Physica A: Statistical Mechanics and Its Applications, 2015, 421: 25-33.
[15] Cheng F W, Wang W J, Guo H S. Dynamic granular support vector machine learning algorithm[J]. Pattern Recognition and Artificial Intelligence, 2014, 27(4): 372-377. 程凤伟, 王文剑, 郭虎升. 动态粒度SVM学习算法[J]. 模式识别与人工智能, 2014, 27(4): 372-377.
[16] Cheng F W, Wang W J. Hierarchical granular support vector machine algorithm[J]. Journal of Chinese Computer Systems, 2015, 36(8): 1799-1802. 程凤伟, 王文剑. 一种层次粒度支持向量机算法[J]. 小型微型计算机系统, 2015, 36(8): 1799-1802.
[17] Brendan J F, Dellbert D. Clustering by passing messages between data points[J]. Science, 2007, 315(2): 972-976.