
Journal of Frontiers of Computer Science and Technology ›› 2026, Vol. 20 ›› Issue (2): 301-325.DOI: 10.3778/j.issn.1673-9418.2506009
• Frontiers·Surveys • Previous Articles Next Articles
LIN Chengde1,2,3, YANG Mingzhe2, MO Chengjun2, LI Guohui3+
Received:2025-06-05
Revised:2025-10-13
Online:2026-02-01
Published:2026-02-01
Supported by:林承德1,2,3,杨铭哲2,莫程俊2,李国翚3+
基金资助:LIN Chengde, YANG Mingzhe, MO Chengjun, LI Guohui. Review of EEG-Based Multimodal Content Generation Techniques[J]. Journal of Frontiers of Computer Science and Technology, 2026, 20(2): 301-325.
林承德, 杨铭哲, 莫程俊, 李国翚. 基于脑电信号的多模态内容生成技术研究综述[J]. 计算机科学与探索, 2026, 20(2): 301-325.
Add to citation manager EndNote|Ris|BibTeX
URL: http://fcst.ceaj.org/EN/10.3778/j.issn.1673-9418.2506009
| [1] VÄRBU K, MUHAMMAD N, MUHAMMAD Y, et al. Past, present, and future of EEG-based BCI applications[J]. Sensors, 2022, 22(9): 3331. [2] XUE Z F, ZHANG Y F, LI H, et al. Instrumentation, measurement, and signal processing in electroencephalography-based brain-computer interfaces: situations and prospects[J]. IEEE Transactions on Instrumentation and Measurement, 2024, 73: 6504128. [3] SONG H, SHE Q S, FANG F, et al. Domain generalization through latent distribution exploration for motor imagery EEG classification[J]. Neurocomputing, 2025, 614: 128889. [4] 吴雪健, 褚亚奇, 赵新刚, 等. 基于空-频特征图学习三维卷积神经网络的运动想象脑电解码方法[J]. 生物医学工程学杂志, 2024, 41(6): 1145-1152. WU X J, CHU Y Q, ZHAO X G, et al. Three-dimensional convolutional neural network based on spatial-spectral feature pictures learning for decoding motor imagery electroencephalography signal[J]. Journal of Biomedical Engineering, 2024, 41(6): 1145-1152. [5] 高晨洋, 吴凯, 李文豪, 等. EEG-fNIRS技术在神经精神疾病研究中的应用进展[J]. 中国医学物理学杂志, 2024, 41(3): 348-355. GAO C Y, WU K, LI W H, et al. Advances in application of EEG-fNIRS technology in researches on neuropsychiatric disorders[J]. Chinese Journal of Medical Physics, 2024, 41(3): 348-355. [6] BLINOWSKA K, DURKA P. Electroencephalography (EEG)[J]. Wiley Encyclopedia of Biomedical Engineering, 2006,10: 9780471740360. [7] SMITH S M. Overview of fMRI analysis[J]. The British Journal of Radiology, 2004, 77(S2): 167-175. [8] VILLRINGER A, PLANCK J, HOCK C, et al. Near infrared spectroscopy (NIRS): a new tool to study hemodynamic changes during activation of brain function in human adults[J]. Neuroscience Letters, 1993, 154(1/2): 101-104. [9] FERRARI M, QUARESIMA V. A brief review on the history of human functional near-infrared spectroscopy (fNIRS) deve-lopment and fields of application[J]. NeuroImage, 2012, 63(2): 921-935. [10] GROSS J, BAILLET S, BARNES G R, et al. Good practice for conducting and reporting MEG research[J]. NeuroImage, 2013, 65: 349-363. [11] BUZSáKI G, ANASTASSIOU C A, KOCH C. The origin of extracellular fields and currents: EEG, ECoG, LFP and spikes[J]. Nature Reviews Neuroscience, 2012, 13(6): 407-420. [12] LACHAUX J P, RUDRAUF D, KAHANE P. Intracranial EEG and human brain mapping[J]. Journal of Physiology-Paris, 2003, 97(4/5/6): 613-628. [13] DA SILVA F L. EEG: origin and measurement[M]//MULERT C, LEMIEUX L. EEG - fMRI. Cham: Springer, 2022: 23-48. [14] LUCK S J, WOODMAN G F, VOGEL E K. Event-related potential studies of attention[J]. Trends in Cognitive Sciences, 2000, 4(11): 432-440. [15] LAROCCO J, LE M D, PAENG D G. A systemic review of available low-cost EEG headsets used for drowsiness detection[J]. Frontiers in Neuroinformatics, 2020, 14: 553352. [16] 崔玉洁, 谢松云, 谢辛舟, 等. 针对快速序列视觉呈现脑电信号的时空混合特征提取方法[J]. 生物医学工程学杂志, 2022, 39(1): 39-46. CUI Y J, XIE S Y, XIE X Z, et al. A spatial-temporal hybrid feature extraction method for rapid serial visual presentation of electroencephalogram signals[J]. Journal of Biomedical Engineering, 2022, 39(1): 39-46. [17] 刘京, 赵薇, 董泽浩, 等. 融合多尺度自注意力机制的运动想象信号解析[J]. 计算机科学与探索, 2023, 17(6): 1427-1440. LIU J, ZHAO W, DONG Z H, et al. Motor imagery signal classification based on multi-scale self-attentional mechanism[J]. Journal of Frontiers of Computer Science and Technology, 2023, 17(6): 1427-1440. [18] 王忠民, 赵玉鹏, 郑镕林, 等. 脑电信号情绪识别研究综述[J]. 计算机科学与探索, 2022, 16(4): 760-774. WANG Z M, ZHAO Y P, ZHENG R L, et al. Survey of research on EEG signal emotion recognition[J]. Journal of Frontiers of Computer Science and Technology, 2022, 16(4): 760-774. [19] 黄红红, 张丰, 吕良福, 等. 神经网络算法在癫痫预测模型中的应用研究综述[J]. 计算机科学与探索, 2023, 17(11): 2543-2556. HUANG H H, ZHANG F, LYU L F, et al. Review of application of neural networks in epileptic seizure prediction[J]. Journal of Frontiers of Computer Science and Technology, 2023, 17(11): 2543-2556. [20] 刘嘉瑞, 朱耿, 施浩洋, 等. 深度学习在阿尔兹海默病患者脑电图分析中的应用综述[J]. 现代仪器与医疗, 2023, 29(5): 63-68. LIU J R, ZHU G, SHI H Y, et al. A review of deep learning in EEG analysis of patients with Alzheimer[J]. Modern Instruments & Medical Treatment, 2023, 29(5): 63-68. [21] TORMA S, SZEGLETES L. Generative modeling and augmentation of EEG signals using improved diffusion probabilistic models[J]. Journal of Neural Engineering, 2025, 22(1): 016001. [22] LOTTE F, BOUGRAIN L, CLERC M. Electroencephalography (EEG)-based brain-computer interfaces[J]. Wiley Encyclopedia of Electrical and Electronics Engineering, 2015: 44. [23] FATOURECHI M, BASHASHATI A, WARD R K, et al. EMG and EOG artifacts in brain computer interface systems: a survey[J]. Clinical Neurophysiology, 2007, 118(3): 480-494. [24] WINKLER I, HAUFE S, TANGERMANN M. Automatic classification of artifactual ICA-components for artifact remo-val in EEG signals[J]. Behavioral and Brain Functions, 2011, 7(1): 30. [25] MCBRIDE J, ZHAO X, NICHOLS T, et al. Classification of traumatic brain injury using support vector machine analysis of event-related Tsallis entropy[C]//Proceedings of the 2011 Biomedical Sciences and Engineering Conference: Image Informatics and Analytics in Biomedicine. Piscataway: IEEE, 2011: 1-4. [26] CARTOCCI G, SCORPECCI A, BORGHINI G, et al. EEG rhythms lateralization patterns in children with unilateral hearing loss are different from the patterns of normal hearing controls during speech-in-noise listening[J]. Hearing Research, 2019, 379: 31-42. [27] STONE J V. Independent component analysis: an introduction[J]. Trends in Cognitive Sciences, 2002, 6(2): 59-64. [28] FARGE M. Wavelet transforms and their applications to turbulence[J]. Annual Review of Fluid Mechanics, 1992, 24: 395-458. [29] 张维, 贺华. 深度学习技术在基于脑电图的脑机接口中的应用进展[J]. 中国医学前沿杂志(电子版), 2025, 17(1): 14-20. ZHANG W, HE H. Advances in deep learning techniques for EEG-based brain-computer interfaces[J]. Chinese Journal of the Frontiers of Medical Science (Electronic Version), 2025, 17(1): 14-20. [30] SHERSTINSKY A. Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network[J]. Physica D: Nonlinear Phenomena, 2020, 404: 132306. [31] KINGMA D P, WELLING M. Auto-encoding variational Bayes[EB/OL]. [2025-04-10]. https://arxiv.org/abs/1312.6114. [32] GOODFELLOW I, POUGET-ABADIE J, MIRZA M, et al. Generative adversarial nets[C]//Advances in Neural Information Processing Systems 27, 2014: 2672-2680. [33] SOHL-DICKSTEIN J, WEISS E A, MAHESWARANATHAN N, et al. Deep unsupervised learning using nonequilibrium thermodynamics[C]//Proceedings of the 32nd International Conference on Machine Learning, 2015: 2256-2265. [34] CHRISTIANO L J, FITZGERALD T J. The band pass filter[J]. International Economic Review, 2003, 44(2): 435-465. [35] HIRANO K, NISHIMURA S, MITRA S. Design of digital notch filters[J]. IEEE Transactions on Communications, 1974, 22(7): 964-970. [36] SAYED A H. Fundamentals of adaptive filtering[M]. Hoboken: Wiley, 2003. [37] 胡倩颖, 任海燕. 脑电仿生电刺激仪联合认知功能锻炼对脑卒中后认知功能障碍患者的疗效[J]. 医疗装备, 2024, 37(12): 73-75. HU Q Y, REN H Y. Efficacy of EEG bionic electrical stimulator combined with cognitive function exercise in patients with post-stroke cognitive dysfunction[J]. Medical Equipment, 2024, 37(12): 73-75. [38] ZHOU K Y, LIU Z W, QIAO Y, et al. Domain generalization: a survey[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45(4): 4396-4415. [39] VETTORUZZO A, BOUGUELIA M R, VANSCHOREN J, et al. Advances and challenges in meta-learning: a technical review[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, 46(7): 4763-4779. [40] GUAN H, YAP P T, BOZOKI A, et al. Federated learning for medical image analysis: a survey[J]. Pattern Recognition, 2024, 151: 110424. [41] 聂聃, 王晓韡, 段若男, 等. 基于脑电的情绪识别研究综述[J]. 中国生物医学工程学报, 2012, 31(4): 595-606. NIE D, WANG X W, DUAN R N, et al. A survey on EEG based emotion recognition[J]. Chinese Journal of Biomedical Engineering, 2012, 31(4): 595-606. [42] MICHAEL K, KYOUNG K. Rotational data augmentation for electroencephalographic data[C]//Proceedings of the 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Piscataway: IEEE, 2017: 471-474. [43] WANG F, ZHONG S H, PENG J F, et al. Data augmentation for EEG-based emotion recognition with deep convolutional neural networks[C]//Proceedings of the 24th International Conference on MultiMedia Modeling. Cham: Springer, 2018: 82-93. [44] LUO Y, ZHU L Z, WAN Z Y, et al. Data augmentation for enhancing EEG-based emotion recognition with deep generative models[J]. Journal of Neural Engineering, 2020, 17(5): 056021. [45] TIAN C X, MA Y L, CAMMON J, et al. Dual-encoder VAE-GAN with spatiotemporal features for emotional EEG data augmentation[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2023, 31: 2018-2027. [46] ZHANG S, SUN L, MAO X Q, et al. ATGAN: attention-based temporal GAN for EEG data augmentation in personal identification[J]. EURASIP Journal on Advances in Signal Processing, 2024, 2024(1): 94. [47] NIU Z Y, ZHONG G Q, YU H. A review on the attention mechanism of deep learning[J]. Neurocomputing, 2021, 452: 48-62. [48] MüLLER-FRANZES G, NIEHUES J M, KHADER F, et al. A multimodal comparison of latent denoising diffusion probabilistic models and generative adversarial networks for medical image synthesis[J]. Scientific Reports, 2023, 13: 12098. [49] SIDDHAD G, IWAMURA M, ROY P P. Enhancing EEG signal-based emotion recognition with synthetic data: diffusion model approach[EB/OL]. [2025-04-18]. https://arxiv.org/abs/2401.16878. [50] HO J, JAIN A, ABBEEL P. Denoising diffusion probabilistic models[C]//Advances in Neural Information Processing Systems 33, 2020: 6840-6851. [51] ZHAO Y D, LIU Y K, ZHENG W L, et al. EEG data augmentation for emotion recognition using diffusion model[C]//Proceedings of the 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Piscataway: IEEE, 2024: 1-4. [52] CHORIN A J, TU X M. Implicit sampling for particle filters[J]. Proceedings of the National Academy of Sciences of the United States of America, 2009, 106(41): 17249-17254. [53] SALIMANS T, HO J. Progressive distillation for fast sampling of diffusion models[EB/OL]. [2025-04-18]. https://arxiv.org/abs/2202.00512. [54] PLUMMER C, VOGRIN S J, WOODS W P, et al. Interictal and ictal source localization for epilepsy surgery using high-density EEG with MEG: a prospective long-term study[J]. Brain, 2019, 142(4): 932-951. [55] VAN MIERLO P, VORDERWüLBECKE B J, STALJANSSENS W, et al. Ictal EEG source localization in focal epilepsy: review and future perspectives[J]. Clinical Neurophysiology, 2020, 131(11): 2600-2616. [56] ZHAO J, WANG C, SUN W B, et al. Tailoring materials for epilepsy imaging: from biomarkers to imaging probes[J]. Advanced Materials, 2022, 34(44): e2203667. [57] COURELLIS H S, IVERSEN J R, POIZNER H, et al. EEG channel interpolation using ellipsoid geodesic length[C]//Proceedings of the 2016 IEEE Biomedical Circuits and Systems Conference. Piscataway: IEEE, 2017: 540-543. [58] HAN S J, KWON M, LEE S, et al. Feasibility study of EEG super-resolution using deep convolutional networks[C]//Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics. Piscataway: IEEE, 2019: 1033-1038. [59] CORLEY I A, HUANG Y F. Deep EEG super-resolution: upsampling EEG spatial resolution with generative adversarial networks[C]//Proceedings of the 2018 IEEE EMBS International Conference on Biomedical & Health Informatics. Piscataway: IEEE, 2018: 100-103. [60] HABASHI A G, AZAB A M, ELDAWLATLY S, et al. Generative adversarial networks in EEG analysis: an overview[J]. Journal of NeuroEngineering and Rehabilitation, 2023, 20(1): 40. [61] TANG Y B, CHEN D, LIU H H, et al. Deep EEG superresolution via correlating brain structural and functional connectivities[J]. IEEE Transactions on Cybernetics, 2023, 53(7): 4410-4422. [62] ZHAO L, SONG Y J, ZHANG C, et al. T-GCN: a temporal graph convolutional network for traffic prediction[J]. IEEE Transactions on Intelligent Transportation Systems, 2020, 21(9): 3848-3858. [63] WANG S Q, ZHOU T, SHEN Y Y, et al. Generative AI enables EEG super-resolution via spatio-temporal adaptive diffusion learning[J]. IEEE Transactions on Consumer Electronics, 2025, 71(1): 1034-1045. [64] VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need [C]//Advances in Neural Information Processing Systems 30, 2017: 5998-6008. [65] LI D D, ZENG Z L, WANG Z, et al. ESTformer: transformer utilising spatiotemporal dependencies for electroencephalogram super-resolution[J]. Knowledge-Based Systems, 2025, 317: 113345. [66] TANG Y B, CHEN C X, CHEN D. Individual EEG super-resolution via ADMM-based coupled matrix decomposition towards long-term brain monitoring[J]. Biomedical Signal Processing and Control, 2025, 103: 107394. [67] COCHRAN W T, COOLEY J W, FAVIN D L, et al. What is the fast Fourier transform?[J]. Proceedings of the IEEE, 1967, 55(10): 1664-1674. [68] POOJA, PAHUJA S K, VEER K. Recent approaches on classification and feature extraction of EEG signal: a review[J]. Robotica, 2022, 40(1): 77-101. [69] 褚亚奇, 朱波, 赵新刚, 等. 基于时空特征学习卷积神经网络的运动想象脑电解码方法[J]. 生物医学工程学杂志, 2021, 38(1): 1-9. CHU Y Q, ZHU B, ZHAO X G, et al. Convolutional neural network based on temporal-spatial feature learning for motor imagery electroencephalogram signal decoding[J]. Journal of Biomedical Engineering, 2021, 38(1): 1-9. [70] SCHIRRMEISTER R T, SPRINGENBERG J T, FIEDERER L D J, et al. Deep learning with convolutional neural networks for EEG decoding and visualization[J]. Human Brain Mapping, 2017, 38(11): 5391-5420. [71] SUN J Y, XIE J, ZHOU H H. EEG classification with transformer-based models[C]//Proceedings of the 2021 IEEE 3rd Global Conference on Life Sciences and Technologies. Piscataway: IEEE, 2021: 92-93. [72] AUNG H W, LI J J, AN Y, et al. A real-time framework for EEG signal decoding with graph neural networks and reinforcement learning[J]. IEEE Transactions on Neural Networks and Learning Systems, 2025, 36(9): 17047-17058. [73] BAGCHI S, BATHULA D R. EEG-ConvTransformer for single-trial EEG-based visual stimulus classification[J]. Pattern Recognition, 2022, 129: 108757. [74] SHANMUGAM S, DHARMAR S. A CNN-LSTM hybrid network for automatic seizure detection in EEG signals[J]. Neural Computing and Applications, 2023, 35(28): 20605-20617. [75] GRAVES A, SCHMIDHUBER J. Framewise phoneme classification with bidirectional LSTM networks[C]//Proceedings of the 2005 IEEE International Joint Conference on Neural Networks, 2005. Piscataway: IEEE, 2005: 2047-2052. [76] LI H D, LI J C, GUAN X M, et al. Research on overfitting of deep learning[C]//Proceedings of the 15th International Conference on Computational Intelligence and Security. Piscataway: IEEE, 2020: 78-81. [77] ALGHAMDI A M, ASHRAF M U, BAHADDAD A A, et al. Cross-subject EEG signals-based emotion recognition using contrastive learning[J]. Scientific Reports, 2025, 15: 28295. [78] LI X M, METSIS V. SPP-EEGNET: an input-agnostic self-supervised EEG representation model for inter-dataset transfer learning[C]//Proceedings of the 18th International Conference on Computing and Information Technology. Cham: Springer, 2022: 173-182. [79] KOSTAS D, AROCA-OUELLETTE S, RUDZICZ F. BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG data[J]. Frontiers in Human Neuroscience, 2021, 15: 653659. [80] OBEID I, PICONE J. The temple university hospital EEG data corpus[J]. Frontiers in Neuroscience, 2016, 10: 196. [81] ALZAHRANI S, BANJAR H, MIRZA R, et al. Systematic review of EEG-based imagined speech classification methods[J]. Sensors, 2024, 24(24): 8168. [82] LEE S, JANG S, CHAN S, et al. Exploring the ability to classify visual perception and visual imagery EEG data: toward an intuitive BCI system[J]. Electronics, 2022, 11(17): 2706. [83] 郑骁. 基于脑电信号的视觉信息解码与视觉场景重建[D]. 长春: 吉林大学, 2022. ZHENG X. Visual information decoding and visual scene reconstruction based on EEG signals[D]. Changchun: Jilin University, 2022. [84] KAVASIDIS I, PALAZZO S, SPAMPINATO C, et al. Brain2Image: converting brain signals into images[C]//Proceedings of the 25th ACM International Conference on Multimedia. New York: ACM, 2017: 1809-1817. [85] WAKITA S, ORIMA T, MOTOYOSHI I. Photorealistic recons-truction of visual texture from EEG signals[J]. Frontiers in Computational Neuroscience, 2021, 15: 754587. [86] LI D, DU C D, HE H G. Semi-supervised cross-modal image generation with generative adversarial networks[J]. Pattern Recognition, 2020, 100: 107085. [87] AHMADIEH H, GASSEMI F, MORADI M H. Visual image reconstruction based on EEG signals using a generative adversarial and deep fuzzy neural network[J]. Biomedical Signal Processing and Control, 2024, 87: 105497. [88] BAI Y P, WANG X T, CAO Y P, et al. DreamDiffusion: generating high-quality images from brain EEG signals[EB/OL]. [2025-04-28]. https://arxiv.org/abs/2306.16934. [89] HE K M, CHEN X L, XIE S N, et al. Masked autoencoders are scalable vision learners[C]//Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2022: 15979-15988. [90] RADFORD A, KIM J W, HALLACY C, et al. Learning transferable visual models from natural language supervision[C]//Proceedings of the 38th International Conference on Machine Learning, 2021: 8748-8763. [91] ROMBACH R, BLATTMANN A, LORENZ D, et al. High-resolution image synthesis with latent diffusion models[C]//Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2022: 10674-10685. [92] LAN Y T, REN K, WANG Y S, et al. Seeing through the brain: image reconstruction of visual perception from human brain signals[EB/OL]. [2025-04-29]. https://arxiv.org/abs/2308.02510. [93] LI J N, LI D X, XIONG C M, et al. BLIP: bootstrapping language-image pre-training for unified vision-language understanding and generation[C]//Proceedings of the 39th International Conference on Machine Learning, 2022: 12888-12900. [94] LI D Y, WEI C, LI S Y, et al. Visual decoding and reconstruction via EEG embeddings with guided diffusion[EB/OL]. [2025-05-02]. https://arxiv.org/abs/2403.07721. [95] PODELL D, ENGLISH Z, LACEY K, et al. SDXL: improving latent diffusion models for high-resolution image synthesis[EB/OL]. [2025-05-02]. https://arxiv.org/abs/2307.01952. [96] YE H, ZHANG J, LIU S B, et al. IP-adapter: text compatible image prompt adapter for text-to-image diffusion models[EB/OL]. [2025-05-03]. https://arxiv.org/abs/2308.06721. [97] LOPEZ E, SIGILLO L, COLONNESE F, et al. Guess what I think: streamlined EEG-to-image generation with latent diffusion models[C]//Proceedings of the 2025 IEEE International Conference on Acoustics, Speech and Signal Processing. Piscataway: IEEE, 2025: 1-5. [98] FU H H, WANG H, CHIN J J, et al. BrainVis: exploring the bridge between brain and visual signals via image reconstruction[C]//Proceedings of the 2025 IEEE International Conference on Acoustics, Speech and Signal Processing. Piscataway: IEEE, 2025: 1-5. [99] KHALEGHI N, REZAII T Y, BEHESHTI S, et al. Visual saliency and image reconstruction from EEG signals via an effective geometric deep network-based generative adversarial network[J]. Electronics, 2022, 11(21): 3637. [100] SHIMIZU H, SRINIVASAN R. Improving classification and reconstruction of imagined images from EEG signals[J]. PLoS One, 2022, 17(9): e0274847. [101] SINGH P, PANDEY P, MIYAPURAM K, et al. EEG2-IMAGE: image reconstruction from EEG brain signals[C]//Proceedings of the 2023 IEEE International Confer-ence on Acoustics, Speech and Signal Processing. Piscat-away: IEEE, 2023: 1-5. [102] ZENG H, XIA N Z, QIAN D G, et al. DM-RE2I: a framework based on diffusion model for the reconstruction from EEG to image[J]. Biomedical Signal Processing and Control, 2023, 86: 105125. [103] SINGH P, DALAL D, VASHISHTHA G, et al. Learning robust deep visual representations from EEG brain recordings[C]//Proceedings of the 2024 IEEE/CVF Winter Conference on Applications of Computer Vision. Piscataway: IEEE, 2024: 7538-7547. [104] LIU M X, GUAN D H, ZHENG C H, et al. ViEEG: hierarchical visual neural representation for EEG brain decoding[EB/OL]. [2025-05-07]. https://arxiv.org/abs/2505.12408. [105] ZHANG E S, ZHANG Z C, HANAKAWA T. Category-aware EEG image generation based on wavelet transform and contrast semantic loss[EB/OL]. [2025-05-07]. https://arxiv.org/abs/2505.24301. [106] ZHANG K F, HE L H, JIANG X, et al. CognitionCapturer: decoding visual stimuli from human EEG signal with multimodal information[C]//Proceedings of the 39th AAAI Conference on Artificial Intelligence. Palo Alto: AAAI, 2025: 14486-14493. [107] RAMIREZ-ARISTIZABAL A G, KELLO C. EEG2Mel: reconstructing sound from brain responses to music[EB/OL]. [2025-05-10]. https://arxiv.org/abs/2207.13845. [108] CHO K, VAN MERRIENBOER B, GULCEHRE C, et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation[EB/OL]. [2025-05-10]. https://arxiv.org/abs/1406.1078. [109] DALY I. Neural decoding of music from the EEG[J]. Scientific Reports, 2023, 13: 624. [110] JIANG H, CHEN Y, WU D, et al. EEG-driven automatic generation of emotive music based on transformer[J]. Frontiers in Neurorobotics, 2024, 18: 1437737. [111] POSTOLACHE E, POLOULIAKH N, KITANO H, et al. Naturalistic music decoding from EEG data via latent diffusion models[C]//Proceedings of the 2025 IEEE International Conference on Acoustics, Speech and Signal Processing. Piscataway: IEEE, 2025: 1-5. [112] AKASHI W, KAMBARA H, OGATA Y, et al. Vowel sound synthesis from electroencephalography during listening and recalling[J]. Advanced Intelligent Systems, 2021, 3(2): 2000164. [113] KRISHNA G, TRAN C, CARNAHAN M, et al. Advancing speech synthesis using EEG[C]//Proceedings of the 10th International IEEE/EMBS Conference on Neural Engineering. Piscataway: IEEE, 2021: 199-204. [114] SHEN K N, LI H N. A low-channel EEG-to-speech conversion approach for assisting people with communication disorders[J]. Smart Health, 2025, 36: 100568. [115] XU Z H, BAI Y R, ZHAO R, et al. Auditory attention decoding from EEG-based Mandarin speech envelope reconstruction[J]. Hearing Research, 2022, 422: 108552. [116] CHEN J X, WANG Y M, ZHANG Z Y, et al. Decoding speaker-normalized pitch from EEG for mandarin perception[EB/OL]. [2025-05-13]. https://arxiv.org/abs/2505.19626. [117] COONEY C, FOLLI R, COYLE D. Neurolinguistics research advancing development of a direct-speech brain-computer interface[J]. iScience, 2018, 8: 103-125. [118] KAMBLE A, GHARE P H, KUMAR V. Deep-learning-based BCI for automatic imagined speech recognition using SPWVD[J]. IEEE Transactions on Instrumentation and Measurement, 2023, 72: 4001110. [119] JEONG J H, CHO J H, LEE B H, et al. Real-time deep neurolinguistic learning enhances noninvasive neural language decoding for brain-machine interaction[J]. IEEE Transactions on Cybernetics, 2023, 53(12): 7469-7482. [120] LEE Y E, LEE S H, KIM S H, et al. Towards voice reconstruction from EEG during imagined speech[C]//Proceedings of the 37th AAAI Conference on Artificial Intelligence and 35th Conference on Innovative Applications of Artificial Intelligence and 30th Symposium on Educational Advances in Artificial Intelligence. Palo Alto: AAAI, 2023: 6030-6038. [121] ZHANG Z H, DING X, BAO Y, et al. Chisco: an EEG-based BCI dataset for decoding of imagined speech[J]. Scientific Data, 2024, 11: 1265. [122] 史鹏程, 王海龙, 柳林. 生理信号情感识别: 跨域迁移与多模态融合综述[J/OL]. 计算机科学与探索 (2025-09-12)[2025-09-28]. https://link.cnki.net/urlid/11.5602.TP.20250912. 0854.002. SHI P C, WANG H L, LIU L. Emotion recognition from physiological signals: a review of cross-domain transfer and multimodal fusion[J/OL]. Journal of Frontiers of Computer Science and Technology (2025-09-12) [2025-09-28]. https://link.cnki.net/urlid/11.5602.TP.20250912. 0854.002. [123] PARK J H, LEE S H, LEE S W. Towards EEG-based talking-face generation for brain signal-driven dynamic communication[C]//Proceedings of the 46th Annual International Conference of the IEEE Engineering in Medicine and Bio-logy Society. Piscataway: IEEE, 2024: 1-5. [124] MIZUNO T, KISHIDA T, YOSHIMURA N, et al. An investigation on the speech recovery from EEG signals using transformer[C]//Proceedings of the 2024 Asia Pacific Signal and Information Processing Association Annual Summit and Conference. Piscataway: IEEE, 2025: 1-6. [125] FAN C H, ZHANG S, ZHANG J J, et al. DMF2Mel: a dyna-mic multiscale fusion network for EEG-driven mel spectrogram reconstruction[EB/OL]. [2025-05-15]. https://arxiv. org/abs/2507.07526. [126] WANG J Q, SONG Z X, MA Z Y, et al. Enhancing EEG-to-text decoding through transferable representations from pre-trained contrastive EEG-text masked autoencoder[EB/OL]. [2025-05-15]. https://arxiv.org/abs/2402.17433. [127] LEWIS M, LIU Y H, GOYAL N, et al. BART: denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension[EB/OL]. [2025-05-15]. https://arxiv.org/abs/1910.13461. [128] AMRANI H, MICUCCI D, NAPOLETANO P. Deep representation learning for open vocabulary electroencephalography-to-text decoding[EB/OL]. [2025-05-16]. https://arxiv.org/abs/2312.09430. [129] TAO Y T, LIANG Y, WANG L Y, et al. SEE: semantically aligned EEG-to-text translation[C]//Proceedings of the 2025 IEEE International Conference on Acoustics, Speech and Signal Processing. Piscataway: IEEE, 2025: 1-5. [130] LIU H W, HAJIALIGOL D, ANTONY B, et al. EEG2TEXT: open vocabulary EEG-to-text decoding with EEG pre-training and multi-view transformer[EB/OL]. [2025-05-18]. https://arxiv.org/abs/2405.02165. [131] JO H, YANG Y Q, HAN J, et al. Are EEG-to-text models working?[EB/OL]. [2025-05-18]. https://arxiv.org/abs/2405.06459. [132] WANG Z, JI H. Open vocabulary electroencephalography-to-text decoding and zero-shot sentiment classification[C]//Proceedings of the 36th AAAI Conference on Artificial Intelligence. Palo Alto: AAAI, 2022: 5350-5358. [133] LIU X Z, SHEN D G, LIU X H. Learning interpretable representations leads to semantically faithful EEG-to-text generation[EB/OL]. [2025-05-20]. https://arxiv.org/abs/2505.17099. [134] CHUNG H W, HOU L, LONGPRE S, et al. Scaling instruction-finetuned language models[J]. Journal of Machine Learning Research, 2024, 25(70): 1-53. [135] HOLLENSTEIN N, ROTSZTEJN J, TROENDLE M, et al. ZuCo, a simultaneous EEG and eye-tracking resource for natural sentence reading[J]. Scientific Data, 2018, 5: 180291. [136] HOLLENSTEIN N, TR?NDLE M, PLOMECKA M, et al. The ZuCo benchmark on cross-subject reading task classification with EEG and eye-tracking data[J]. Frontiers in Psychology, 2023, 13: 1028824. [137] MOU X Y, HE C L, TAN L W, et al. ChineseEEG: a Chinese linguistic corpora EEG dataset for semantic alignment and neural decoding[J]. Scientific Data, 2024, 11: 550. [138] LU J T, CHIANG J, CHEN C S, et al. EEG2TEXT-CN: an exploratory study of open-vocabulary Chinese text-EEG alignment via large language model and contrastive learning on ChineseEEG[EB/OL]. [2025-05-23]. https://arxiv.org/abs/2506.00854. [139] FENG X C, FENG X C, QIN B, et al. Aligning semantic in brain and language: a curriculum contrastive method for electroencephalography-to-text generation[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2023, 31: 3874-3883. [140] CHEN Q P, WANG Y M, WANG F M, et al. Decoding text from electroencephalography signals: a novel hierarchical gated recurrent unit with masked residual attention mechanism[J]. Engineering Applications of Artificial Intelligence, 2025, 139: 109615. [141] EL GEDAWY M, NABIL O, MAMDOUH O, et al. Bridging brain signals and language: a deep learning approach to EEG-to-text decoding[EB/OL]. [2025-05-24]. https://arxiv.org/abs/2502.17465. [142] LIU X H, LIU Y K, WANG Y S, et al. EEG2Video: towards decoding dynamic visual perception from EEG signals[C]//Advances in Neural Information Processing Systems 38, 2024: 72245-72273. [143] SUTSKEVER I, VINYALS O, LE Q V. Sequence to sequence learning with neural networks[C]//Advances in Neural Information Processing Systems 27, 2014: 3104-3112. [144] DENG J, DONG W, SOCHER R, et al. ImageNet: a large-scale hierarchical image database[C]//Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2009: 248-255. [145] SINGH P, SHARMA A, PANDEY P, et al. Dynamic vision from EEG brain recordings, how much does EEG know? [EB/OL]. [2025-05-26]. https://arxiv.org/abs/2505.21385. [146] LIU J X, LIN J M, LI J T, et al. DynaMind: reconstructing dynamic visual scenes from EEG by aligning temporal dyna-mics and multimodal semantics to guided diffusion[EB/OL]. [2025-05-28]. https://arxiv.org/abs/2509.01177. |
| [1] | HUANG Ping, WANG Feng, LIU Guangteng, WU Zhongbo, LI Xiaoli, HUANG Jinzhou. Survey on Deep Learning Applications in Point-of-Interest Recommendation [J]. Journal of Frontiers of Computer Science and Technology, 2026, 20(3): 671-710. |
| [2] | TIAN Yingzhe, DONG Wu, LU Likun, MA Qian, ZHOU Ziyi, ZHANG Erqing. Research Status and Prospects of Omnidirectional Image Quality Assessment Based on Deep Learning [J]. Journal of Frontiers of Computer Science and Technology, 2026, 20(3): 650-670. |
| [3] | FANG Jinfeng, ZHANG Zhenwei, MENG Xiangfu. Advancements in Deep Learning-Based Vehicle Trajectory Prediction Research [J]. Journal of Frontiers of Computer Science and Technology, 2026, 20(2): 346-366. |
| [4] | LI Yuzhe, HAO Qinghua, GAO Zhifa, XIE Rongzhen, ZHAO Ling, ZHOU Yu. Review on Image Enhancement for Low SNR and Low-Light Scenes [J]. Journal of Frontiers of Computer Science and Technology, 2026, 20(2): 409-421. |
| [5] | WANG Yanjie, WANG Xiaoqiang, ZHAO Liurui, ZHUANG Xufei. Review of Multi-person Abnormal Behavior Detection Based on Deep Learning [J]. Journal of Frontiers of Computer Science and Technology, 2026, 20(2): 326-345. |
| [6] | GUO Zhen, LIU Jing, QIU Dawei, LI Yuhao. Review of YOLO Algorithm Research for 2D Medical Image Detection [J]. Journal of Frontiers of Computer Science and Technology, 2026, 20(1): 79-98. |
| [7] | CHEN Long, SHI Lei, LI Zhihui, DING Meng, PAN Yilun. Survey of Deep Learning-Based UAV Single Object Tracking [J]. Journal of Frontiers of Computer Science and Technology, 2026, 20(1): 40-65. |
| [8] | MENG Xiangfu, LI Jiaxun, YU Chunlin, LU Yunxuan. Research Review of Deep Learning in Skin Lesions Image Segmentation [J]. Journal of Frontiers of Computer Science and Technology, 2026, 20(1): 21-39. |
| [9] | LIU Xiaojia, CHEN Hongyu, YU Dexin, CHEN Yunjie, ZHOU Yuqin. Review of Trajectory Prediction for Autonomous Vehicles Based on Short-Term and Long-Term Characteristics [J]. Journal of Frontiers of Computer Science and Technology, 2025, 19(9): 2363-2383. |
| [10] | WEI Zongyue, QIU Dawei, LIU Jing, LI Zhenjiang, CHANG Shaohua. Research and Progress of Deep Learning in Diagnosis of Upper Limb Fractures [J]. Journal of Frontiers of Computer Science and Technology, 2025, 19(9): 2341-2362. |
| [11] | HUA Chunjian, YAO Yetao, JIANG Yi, YU Jianfeng, CHEN Ying. RGB-D Saliency Detection with Feature Enhancement and Progressive Decoding [J]. Journal of Frontiers of Computer Science and Technology, 2025, 19(9): 2419-2429. |
| [12] | YANG Bin, MA Tinghuai, HUANG Xuejian, WANG Yubo, WANG Zhaoming, ZHAO Bowen, YU Xin. Time Series Anomaly Detection Based on Spatio-Temporal Feature Fusion and Sequence Reconstruction [J]. Journal of Frontiers of Computer Science and Technology, 2025, 19(9): 2384-2398. |
| [13] | HONG Wei, GENG Peilin, WANG Hongyu, ZHANG Xueqin, GU Chunhua. Local Dynamic Clean-Label Backdoor Attack with Image Salience Regions [J]. Journal of Frontiers of Computer Science and Technology, 2025, 19(8): 2229-2240. |
| [14] | ZHANG Yifei, LI Yanling, GE Fengpei. Review of Legal Judgment Prediction Based on Graph Deep Learning [J]. Journal of Frontiers of Computer Science and Technology, 2025, 19(8): 2024-2042. |
| [15] | MIN Feng, LIU Yuzhuo, LIU Yuhui, LIU Biao. Multivariate Time Series Prediction Model Based on Mixed Features of Time Domain and Frequency Domain [J]. Journal of Frontiers of Computer Science and Technology, 2025, 19(8): 2099-2109. |
| Viewed | ||||||
|
Full text |
|
|||||
|
Abstract |
|
|||||
/D:/magtech/JO/Jwk3_kxyts/WEB-INF/classes/