新型鲁棒孪生支持向量回归机

doi:10.3778/j.issn.1673-9418.2107135

计算机科学与探索 ›› 2023, Vol. 17 ›› Issue (5): 1157-1167.DOI: 10.3778/j.issn.1673-9418.2107135

新型鲁棒孪生支持向量回归机

陈素根，石婷

1. 安庆师范大学数理学院，安徽安庆 246133
2. 安徽省大别山区域复杂生态系统建模、仿真与控制重点实验室，安徽安庆 246133
3. 安徽省皖江流域种群生态模拟与控制国际联合研究中心，安徽安庆 246133

出版日期:2023-05-01 发布日期:2023-05-01

Novel Robust Twin Support Vector Regression

CHEN Sugen, SHI Ting

1. School of Mathematics and Physics, Anqing Normal University, Anqing, Anhui 246133, China
2. Key Laboratory of Modeling, Simulation and Control of Complex Ecosystem in Dabie Mountains of Anhui Higher Education Institutes, Anqing, Anhui 246133, China
3. International Joint Research Center of Simulation and Control for Population Ecology of Yangtze River in Anhui Province, Anqing, Anhui 246133, China

Online:2023-05-01 Published:2023-05-01

摘要/Abstract

摘要： 回归问题是模式识别与机器学习领域的基本问题之一，孪生支持向量回归机（TSVR）是在支持向量回归机（SVR）基础上发展而来的一种处理回归问题的新算法，它在处理无噪声数据时表现出较好的性能，但在处理有噪声数据时往往性能不佳。为了降低噪声对孪生支持向量回归机性能的影响，结合[ε]-不敏感损失函数与Huber损失函数构造了混合[Hε]损失函数，该损失函数可以有效地适应于不同分布类型的噪声；然后基于混合[Hε]损失函数和结构风险最小化（SRM）原则提出了一种鲁棒的孪生支持向量回归机（[Hε]-TSVR），并在原始空间中利用牛顿迭代法求解模型。分别在有噪声和无噪声的人工数据集、UCI数据集上进行实验，与支持向量回归机和孪生支持向量回归机等算法比较，实验结果验证了所提算法的有效性。

关键词: 模式识别, 支持向量回归机（SVR）, 孪生支持向量回归机（TSVR）, 损失函数

Abstract: Regression problem is one of the basic problems in the field of pattern recognition and machine learning. Twin support vector regression (TSVR) is a new algorithm to deal with regression problems developed on the basis of support vector regression (SVR). It has good performance in dealing with noiseless data, but poor performance in dealing with noisy data.?In order to reduce the influence of noise on the performance of TSVR, the mixed Hε loss function is constructed by combining ε -insensitive loss function and Huber loss function, which can be effectively adapted to the noise of different distributions. Then, a robust twin support vector regression (Hε-TSVR) is proposed based on the mixed [Hε] loss function and the principle of structural risk minimization (SRM), and the model is solved by Newton iterative method in the primal space. Experiments are carried out on some noisy and noiseless artificial datasets and UCI datasets respectively, and the experimental results verify the effectiveness of the proposed algorithm compared with SVR and TSVR, etc.

Key words: pattern recognition, support vector regression (SVR), twin support vector regression (TSVR), loss function

陈素根, 石婷. 新型鲁棒孪生支持向量回归机[J]. 计算机科学与探索, 2023, 17(5): 1157-1167.

CHEN Sugen, SHI Ting. Novel Robust Twin Support Vector Regression[J]. Journal of Frontiers of Computer Science and Technology, 2023, 17(5): 1157-1167.

参考文献

[1] VAPNIK V N. Statistical learning theory[M]. New York: Wiley Press, 1998: 401-421.
[2] KHEMCHANDANI J R, CFANDRA S. Twin support vector machines for pattern classification[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(5): 905-910.
[3] PENG X J. TSVR: an efficient twin support vector machine for regression[J]. Neural Networks, 2010, 23(3): 365-372.
[4] SHAO Y H, ZHANG C H. An ε-twin support vector machine for regression[J]. Neural Computing and Applications, 2013, 23(1): 175-185.
[5] 丁世飞, 黄华娟. 最小二乘孪生参数化不敏感支持向量回归机[J]. 软件学报, 2017, 28(12): 3146-3155.
DING S F, HUANG H J. Least squares twin parametric insensitive support vector regression[J]. Journal of Software, 2017, 28(12): 3146-3155.
[6] XU Y T, YANG Z J, PAN X L. A novel twin support vector machine with pinball loss[J]. IEEE Transactions on Neural Networks & Learning Systems, 2017, 28(2): 359-370.
[7] 曹杰, 顾斌杰, 熊伟丽, 等. 增量式约简最小二乘孪生支持向量回归机[J]. 计算机科学与探索, 2021, 15(3): 553-563.
CAO J, GU B J, XIONG W L, et al. Incremental reduced least twin squares support vector regression[J]. Journal of Frontiers of Computer Science and Technology, 2021, 15(3): 553-563.
[8] YE Y F, GAO J B, SHAO Y H, et al. Robust support vector regression with generic quadratic nonconvex ε-insensitive loss[J]. Applied Mathematical Modelling, 2020, 82: 235-251.
[9] BALASUNDARAM S, PRASAD S C. Robust twin support vector regression based on Huber loss function[J]. Neural Computing and Applications, 2020, 32: 11285-11309.
[10] GUPTA U, GUPTA D. On regularization based twin support vector regression with Huber loss[J]. Neural Processing Letters, 2021, 53: 459-515.
[11] OLIVIER C. Training a support vector machine in the primal[J]. Neural Computation, 2007, 19(5): 1155-1178.
[12] SINGLA M, GHOSH D, SHUKLA K K, et al. Robust twin support vector regression based on rescaled hinge loss[J]. Pattern Recognition, 2020, 105: 107-395.
[13] TANVEER M, SHARMA A, SUGANTHAN P N. General twin support vector machine with pinball loss function[J]. Information Sciences, 2019, 494: 311-327.
[14] DONG H W, YANG L M. Training robust support vector regression machines for more general noise[J]. Journal of Intelligent & Fuzzy Systems, 2020, 39(3): 2881-2892.
[15] 马梦萍, 杨志霞. 非对称v-无核二次曲面支持向量回归机[J]. 计算机工程与应用, 2021, 57(7): 70-77.
MA M P, YANG Z X. Asymmetric ν-kernel-free quadratic surface support vector regression[J]. Computer Engineering and Applications, 2021, 57(7): 70-77.
[16] PENG X J. Primal twin support vector regression and its sparse approximation[J]. Neurocomputing, 2010, 73: 2846-2858.
[17] CHEN C F, YAN C Q, ZHAO N, et al. A robust algorithm of support vector regression with a trimmed Huber loss function in the primal[J]. Soft Computing, 2017, 21: 5235-5243.
[18] DEMSAR J. Statistical comparisons of classifiers over mul-tiple data sets[J]. Journal of Machine Learning Research, 2006, 7(1): 1-30.

新型鲁棒孪生支持向量回归机

Novel Robust Twin Support Vector Regression

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 10

编辑推荐

Metrics

[1]	孙方伟, 李承阳, 谢永强, 李忠博, 杨才东, 齐锦. 深度学习应用于遮挡目标检测算法综述[J]. 计算机科学与探索, 2022, 16(6): 1243-1259.
[2]	马力, 邹亚莉. 嵌入自注意力机制的美学特征图像生成方法[J]. 计算机科学与探索, 2021, 15(9): 1728-1739.
[3]	孙宇, 魏本征, 刘川, 张魁星, 丛金玉. 融减自动编码器[J]. 计算机科学与探索, 2021, 15(8): 1526-1533.
[4]	曹杰, 顾斌杰, 熊伟丽, 潘丰. 增量式约简最小二乘孪生支持向量回归机[J]. 计算机科学与探索, 2021, 15(3): 553-563.
[5]	彭晏飞，高艺，杜婷婷，桑雨，訾玲玲. 生成对抗网络的单图像超分辨率重建方法[J]. 计算机科学与探索, 2020, 14(9): 1612-1620.
[6]	王小玉，韩昌林，胡鑫豪. 加权特征融合的密集连接网络人脸识别算法[J]. 计算机科学与探索, 2019, 13(7): 1195-1205.
[7]	褚晶辉，罗薇，吕卫. 多图嵌入表示在人体运动模式识别中的应用[J]. 计算机科学与探索, 2017, 11(6): 941-949.
[8]	张江滨，邓赵红，王士同. 模糊子空间聚类的径向基函数神经网络建模[J]. 计算机科学与探索, 2015, 9(12): 1513-1522.
[9]	高新豫，杨志霞，卢振兴. 非平行ε-带支持向量回归机[J]. 计算机科学与探索, 2013, 7(7): 649-658.
[10]	邱晓红 . 多类别模糊补偿支持向量机新模型研究[J]. 计算机科学与探索, 2009, 3(3): 330-336.