Research on cognitive mechanism and braincomputer interface application in visualauditory crossmodal stimuli
CSTR:
Author:
Affiliation:

1. Department of Biomedical Engineering, Tianjin University, Tianjin 300072, China; 2. Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, China; 3. China Astronaut Research and Training Center, Beijing 100092, China

Clc Number:

R318

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    The information of image, voice, and text (language), which is closely related to the human perception of visual and auditory, plays an important role in socioeconomic development and country security assurance. Braincomputer interface (BCI) is an innovative technology that directly controls peripheral equipment and makes ‘thought’ into ‘action’ with nonmuscular methods. Visual and auditory stimuli based BCI system has extremely broad application prospects. It is commonly believed that brain has stronger eventrelated potential, higher reaction accuracy and faster reaction speed on visualauditory crossmodal stimuli (VACS) than single modal stimuli (visual or auditory) in current cognitive psychology researches, while BCI researches have difficulty on the verification of the VACS superiority. In this paper, the VACS researches in cognitive psychology and BCI paradigms were reviewed respectively, which included the information integration mechanism of VACS, the facilitation and competition relationship between visual stimuli and auditory stimuli in VACS system, the influence of congruence and the research status of VACS based BCI paradigms. Also, the reasons for not showing the superiority of VACS in BCI system were discussed. Then, the countermeasure of defusing the difficulties were presented from aspects of the selection of BCI paradigms, the performance improvement of system hardware, the signal processing of electroencephalography(EEG) and so on. In the end, the future trends of VACS based BCI research were presented.

    Reference
    Related
    Cited by
Get Citation
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:
  • Revised:
  • Adopted:
  • Online: September 14,2017
  • Published:
Article QR Code