Classification of Alzheimer's Disease Integrating Individual Feature and Fusion Feature

doi:10.3778/j.issn.1673-9418.2112058

Abstract

Abstract: Intelligence diagnosis has been widely studied in the diagnosis of Alzheimer's disease (AD), but existing intelligent modeling methods cannot make full use of the multi-modal data feature information. As a result, the recognition accuracy is not high in the diagnosis of disease in the early stage. In order to improve the diagnosis effect of AD and its early stage, a classification method of Alzheimer's disease integrating individual feature and fusion feature is proposed. Firstly, the hypergraph convolutional network (HGCN) is used to extract features from the data of three modalities of MRI (magnetic resonance imaging), PET (positron emission computed tomography), and CSF (cerebro-spinal fluid) to obtain the high-order deep feature. At the same time, the data of these three modalities are fused through low-rank multimodal fusion to obtain hidden correlation features among multiple modalities. Finally, a multi-view classifier is used to comprehensively classify the above-obtained features. The ADNI dataset is used to classify AD in multiple groups of tasks to verify the proposed method. Compared with other state-of-the-art methods, the proposed method effectively improves the classification accuracy in the early stage of the disease while ensuring the classification effect of the AD stage.

Key words: multi-modal, hypergraph convolutional network (HGCN), low-rank multimodal fusion, multi-view classification, Alzheimer's disease (AD)

摘要： 智能诊断在阿尔茨海默病（AD）的诊断中已得到广泛研究，但已有的智能建模方法还不能充分利用多模态的数据信息，以至于在病程早期阶段的诊断中出现识别精确度不高的问题。为提高阿尔茨海默病及其早期阶段智能诊断的效果，提出一种兼顾个性特征和融合特征的阿尔茨海默病分类方法。首先使用超图卷积网络（HGCN）对MRI、PET和CSF三个模态的数据分别进行特征提取，以获得每个模态的高阶深度特征。同时通过低秩多模态融合对这三个模态的数据进行特征融合，以获得多个模态之间的隐藏关联特征。最后通过一个多视角分类器对以上获取的特征进行综合分类。利用ADNI数据集对阿尔茨海默病进行多组任务分类，以验证所提方法。与其他先进方法相比，该方法在保证AD阶段分类效果的情况下，有效提高了病程早期阶段的分类精度。

关键词: 多模态, 超图卷积网络（HGCN）, 低秩多模态融合, 多视角分类, 阿尔茨海默病（AD）

CAO Yingli, DENG Zhaohong, HU Shudong, WANG Shitong. Classification of Alzheimer's Disease Integrating Individual Feature and Fusion Feature[J]. Journal of Frontiers of Computer Science and Technology, 2023, 17(7): 1658-1668.

曹营利, 邓赵红, 胡曙东, 王士同. 兼顾个性特征和融合特征的阿尔茨海默病分类[J]. 计算机科学与探索, 2023, 17(7): 1658-1668.

References

[1] WILSON R S, SEGAWA E, BOYLE P A, et al. The natural history of cognitive decline in Alzheimer??s disease[J]. Psy-chology and Aging, 2012, 27(4): 1008-1017.
[2] PATTERSON C. World Alzheimer report 2018: the state of the dementia research: new frontiers[R]. London, 2018.
[3] ASSOCIATION A S. 2018 Alzheimer??s disease facts and figures[J]. Alzheimers Dement, 2018, 14(3): 367-429.
[4] BRON E E, SMITS M, NIESSEN W J, et al. Feature selec-tion based on the SVM weight vector for classification of dementia[J]. IEEE Journal of Biomedical and Health Infor-matics, 2015, 19(5): 1617-1626.
[5] BI X A, HU X, WU H, et al. Multimodal data analysis of Alzheimer??s disease based on clustering evolutionary ran-dom forest[J]. IEEE Journal of Biomedical and Health In-formatics, 2020, 24(10): 2973-2983.
[6] HUANG Y, XU J, ZHOU Y, et al. Diagnosis of Alzheimer??s disease via multi-modality 3D convolutional neural network[J]. Frontiers in Neuroscience, 2019, 13: 509.
[7] HONG X, LIN R, YANG C, et al. Predicting Alzheimer??s disease using LSTM[J]. IEEE Access, 2019, 7: 80893-80901.
[8] FENG C, ELAZAB A, YANG P, et al. Deep learning frame-work for Alzheimer??s disease diagnosis via 3D-CNN and FSBi-LSTM[J]. IEEE Access, 2019, 7: 63605-63618.
[9] KAM T E, ZHANG H, JIAO Z, et al. Deep learning of static and dynamic brain functional networks for early MCI detec-tion[J]. IEEE Transactions on Medical Imaging, 2020, 39(2): 478-487.
[10] PAN X, PHAN T L, ADEL M, et al. Multi-view separable pyramid network for AD prediction at MCI stage by 18F-FDG brain PET imaging[J]. IEEE Transactions on Medical Imaging, 2021, 40(1): 81-92.
[11] LIU M, CHENG D, WANG K, et al. Multi-modality cas-caded convolutional neural networks for Alzheimer??s disease diagnosis[J]. Neuroinformatics, 2018, 16(3/4): 295-308.
[12] JIE B, ZHANG D, CHENG B, et al. Manifold regularized multitask feature learning for multimodality disease classi-fication[J]. Human Brain Mapping, 2015, 36(2): 489-507.
[13] 彭瑶, 祖辰, 张道强. 基于超图的多模态特征选择算法及其应用[J]. 计算机科学与探索, 2018, 12(1): 112-119.
PENG Y, ZU C, ZHANG D Q. Hypergraph based multi-modal feature selection and its application[J]. Journal of Frontiers of Computer Science and Technology, 2018, 12(1): 112-119.
[14] SHAO W, PENG Y, ZU C, et al. Hypergraph based multi-task feature selection for multimodal classification of Al-zheimer??s disease[J]. Computerized Medical Imaging and Graphics, 2020, 80: 101663.
[15] DENG Z, CHOI K S, JIANG Y, et al. Generalized hidden-mapping ridge regression, knowledge-leveraged inductive transfer learning for neural networks, fuzzy systems and kernel methods[J]. IEEE Transactions on Cybernetics, 2014, 44(12): 2585-2599.
[16] JIANG Y, DENG Z, CHUNG F L, et al. Recognition of epileptic EEG signals using a novel multiview TSK fuzzy system[J]. IEEE Transactions on Fuzzy Systems, 2016, 25(1): 3-20.
[17] ZADEH A, CHEN M, PORIA S, et al. Tensor fusion network for multimodal sentiment analysis[J]. arXiv:1707.07250, 2017.
[18] LIU Z, SHEN Y, LAKSHMINARASIMHAN V B, et al. Efficient low-rank multimodal fusion with modality-specific factors[J].arXiv:1806.00064, 2018.
[19] FENG Y F, YOU H X, ZHANG Z H, et al. Hypergraph neural networks[C]//Proceedings of the 33rd AAAI Conference on Artificial Intelligence, the 31st Innovative Applications of Artificial Intelligence Conference, the 10th AAAI Sym-posium on Educational Advances in Artificial Intelligence,Honolulu, Jan 27-Feb 1, 2019. Menlo Park: AAAI， 2019: 3558-3565.
[20] ZHANG D, WANG Y, ZHOU L, et al. Multimodal classi-fication of Alzheimer??s disease and mild cognitive impair-ment[J]. NeuroImage, 2011, 55(3): 856-867.
[21] 程波, 朱丙丽, 熊江. 基于多模态多标记迁移学习的早期阿尔茨海默病诊断[J]. 计算机应用, 2016, 36(8): 2282-2286.
CHENG B, ZHU B L, XIONG J. Multimodal multi-label transfer learning for early diagnosis of Alzheimer??s disease [J]. Journal of Computer Applications, 2016, 36(8): 2282-2286.
[22] SUK H I, LEE S W, SHEN D, et al. Deep sparse multi-task learning for feature selection in Alzheimer??s disease diag-nosis[J]. Brain Structure and Function, 2016, 221(5): 2569-2587.
[23] TONG T, GRAY K, GAO Q, et al. Multi-modal classifica-tion of Alzheimer??s disease using nonlinear graph fusion[J]. Pattern Recognition, 2017, 63: 171-181.