Skip to main content

Asynchronous BCI control using high-frequency SSVEP

Abstract

Background

Steady-State Visual Evoked Potential (SSVEP) is a visual cortical response evoked by repetitive stimuli with a light source flickering at frequencies above 4 Hz and could be classified into three ranges: low (up to 12 Hz), medium (12-30) and high frequency (> 30 Hz). SSVEP-based Brain-Computer Interfaces (BCI) are principally focused on the low and medium range of frequencies whereas there are only a few projects in the high-frequency range. However, they only evaluate the performance of different methods to extract SSVEP.

Methods

This research proposed a high-frequency SSVEP-based asynchronous BCI in order to control the navigation of a mobile object on the screen through a scenario and to reach its final destination. This could help impaired people to navigate a robotic wheelchair. There were three different scenarios with different difficulty levels (easy, medium and difficult). The signal processing method is based on Fourier transform and three EEG measurement channels.

Results

The research obtained accuracies ranging in classification from 65% to 100% with Information Transfer Rate varying from 9.4 to 45 bits/min.

Conclusions

Our proposed method allows all subjects participating in the study to control the mobile object and to reach a final target without prior training.

Background

A Brain-Computer Interface (BCI) is a system that helps impaired people to control a device (such as a robotic wheelchair) using their own brain signals. These brain signals can be obtained from the scalp as electroencephalographic (EEG) signals.

A Steady-State Visual Evoked Potential (SSVEP) is a resonance phenomenon arising mainly in the visual cortex when a person is focusing the visual attention on a light source flickering with a frequency above 4 Hz [1]. SSVEPs are periodic, with a stationary distinct spectrum showing characteristic SSVEPs peaks, stable over time [2].

The SSVEP can be elicited up to at least 90 Hz [3] and could be classified into three ranges: low (up to 12 Hz), medium (12-30) and high frequency (> 30 Hz) [1]. In general, the SSVEP in low frequency range has larger amplitude responses than in the medium range. Consequently, while the larger the amplitude of the SSVEP, the easier its detection. The weakest SSVEP is found in the high frequency range. However, spontaneous EEG (considered here as noise) decrease in higher frequency bands, hence, the signal to noise ratio is similar for three ranges [4].

However, the majority of SSVEP-based BCI are principally focused in the low and medium range of frequencies [58]. There is only scant research in the high frequency range: in [9] Independent Component Analysis (ICA) was used to detect early SSVEP at 8.8 and 35 Hz, in [10] an alternate half field SSVEP is implemented between 25 to 40 Hz for the detection of 8 symbols on a virtual keypad. Canonical correlation analysis (CCA) is applied to detect SSVEP in the 27 to 43 Hz range in [11]. In [12] the Wavelet Transform and Hilbert-Huang Transform (HHT) are compared to detect SSVEP in 10 s EEG for stimulation between 30 up to 50 Hz. More recently, spatial filters were applied to enhance the SSVEP detection in four oscillatory visual stimuli at 30, 35, 40, and 45 Hz, in [13].

In [9] and [1113] off-line analysis of the EEG were performed using methods with medium to high computational cost such as ICA, CCA, HHT and spatial filters. An updated and interesting review of SSVEP-based BCI is presented in [14], where frequencies, stimulation devices, colour, bit rate and other details of BCIs are offered.

The high-frequency SSVEP range has the advantage of a great decrease of visual fatigue caused by flickering [10, 12, 15], making the SSVEP-based BCI a more comfortable and stable system [15]. Besides, low and medium frequency SSVEP ranges interfere with alpha rhythm, and could cause an epileptic seizure as well [16].

Finally, a BCI can be classified into synchronous or asynchronous. A synchronous BCI needs a synchronization cue for the beginning of each mental task (or gazing at a flickering light), i.e., it is a time-locked BCI. On the other hand, in asynchronous BCI the ongoing EEG is used since the subject can change his mental state (or gaze at a light) at any moment. Of course, asynchronous BCI is more difficult to implement, since they can experience idle states where the user does not gaze at any flickering light.

The objective of this research is to control the navigation of a mobile object on the screen through different environments using a high-frequency SSVEP-based asynchronous BCI. A future objective of this approach aims at the navigation of a mobile robot (e.g. a robotic wheelchair) under partially-structured environments.

Methods

EEG acquisition

Six subjects (ages 32 ± 3; 1 F and 5 M) participated in this study. All subjects provided written consent to participate and ethical approval was granted by the institutional ethics committee. The subjects were seated in a comfortable chair in front of a monitor with four bars on each side (10 cm × 2.5 cm), illuminated by high efficiency light-emitting diodes (LEDs) (Figure 1). These LEDs are flicker at 37, 38, 39 and 40 Hz for the bars on top, to the right, then down and to the bars on the left, respectively. These flickering frequencies are almost unperceivable by the user. The frequency of each LED is precisely controlled with an FPGA Xilinx Spartan2E.

Figure 1
figure 1

EEG acquisition equipment and lights on the sides of monitor. Left image: A subject using the SSVEP-based BCI. Right image: acquisition equipment and monitor displaying the difficult scenario.

The EEG was measured with six channels at O1, Oz, O2, P3, Pz and P4, referenced to FZ and grounded at linked A1-A2, but only O1, Oz and O2 channels were used for on-line feedback. These positions were chosen since they are over visual cortex where SSVEP have higher amplitude [2]. Positions P3, Pz and P4 were acquired for further studies, but they were not used in this work. The EEG signals were acquired with a Grass MP15 amplifiers system and digitalized with a NI-DAQPad6015 (Sample Frequency = 256 Hz for each channel). Cut-off frequencies of analogical pass-band filter were set to 3 and 100 Hz and a notch filter for 50 Hz line interference was used.

For each subject, a baseline EEG was acquired previous to the experiment, where the subjects were asked to focus on a point in the centre of the screen for 60 s, but not to focus on any bar. This baseline was used for equalization of EEG spectrum; this will be explained on Section 3. Two different experiments were carried out: 1) A time-locked (synchronous) step and 2) An asynchronous control step.

Time-locked step

The purpose of this step is to evaluate the performance of the proposed interface in a controlled experiment, since in the next step (asynchronous control) the subject is who controls the experiment. For this purpose, this step is divided into trials, where, the light that the subject must gaze at is indicated for each trial.

Each trial lasted 10 s with a variable separation between trials from 2 to 4 s. The trial begins with a beep (t = 0 s) and 2 s later a flickering bar is randomly indicated to the subject with an arrow on the screen; at this time the EEG signal is processed on-line and feedback is presented at the end of each trial. All subjects participated in four sessions and each session contains 20 trials, with only a few minutes between sessions.

The possible results of the classification process were:

  1. 1.

    Correct: an SSVEP was detected and it corresponds to the bar indicated by the arrow on the screen, this is a True Positive (TP).

  2. 2.

    Incorrect: an SSVEP was detected and it is different from the bar indicated by the arrow on the screen, this is a False Positive (FP).

  3. 3.

    No detection: this situation occurs when the subject does not concentrate enough on the light or the proposed method does not detect an SSVEP, this is a False Negative (FN).

Additional file 1 shows a subject performing this time-locked step.

Additional file 1:BCI Synchronous step. A movie shows the BCI time-locked (synchronous) step. (MOV 6 MB)

Asynchronous control step

In order to evaluate the performance of the proposed method for ongoing EEG, software was developed where the user had to control a mobile ball and navigate it through a scenario to reach a final spot (white square). There were three different scenarios with different difficulty levels (easy, medium and difficult) as can be seen in Figure 2. The user can choose his path to reach the final destination.

Figure 2
figure 2

Different scenarios proposed for ongoing EEG. (easy, medium and difficult scenarios). Blue circle: the ball; white square: final spot.

When a SSVEP is detected the ball moves in the direction of the detected light, and it continues moving until another SSVEP is detected or when the ball hits a wall. The user can stop the ball gazing at the opposite light of the current direction. The experiment ends when mobile ball arrives to the final spot or when more than 3 minutes are required to complete the task. Additional file 2 shows some subjects navigating the ball through the three scenarios.

Additional file 2:BCI asynchronous step. Another movie shows the BCI asynchronous step control of mobile object on the screen through different scenarios. (MOV 19 MB)

EEG signal processing

The EEG was analysed with a window of 2 s duration, moving in steps of 0.25 s, i.e., the EEG signal processing is performed 4 times by second. The processing method is similar to a previous research project done by our group [17], this one was based in [7] (but they were applied to detection of medium and low frequencies SSVEP).

A Butterworth band-pass digital filter, order 6, with 32 and 45 Hz cut-off frequencies was utilized. Afterwards, the periodogram was computed. It is an estimation of the power spectral density based on the Discrete Time Fourier Transform (DTFT) of the signal x[n]defined as:

(1)

where S P (f) is the periodogram, T S is the sampling period, N is the number of samples of the signal and f is the frequency. To compute the periodogram, the Fast Fourier Transform (FFT) with 2 s length rectangular window and zero padding to 1024 points was used.

Following that, we propose to compute the normalized power at each stimulation frequency as the mean value of the power on each channel [17]:

(2)

where P(fi) is the normalized power estimation for frequency fi (i = 37, 38, 39 or 40 Hz); ch is the number of channel; Δf is the bandwidth of the power estimation: ± 0.25 Hz; is the periodogram of baseline EEG used for equalization purpose, since the EEG spectrum has lower power for higher frequencies. This means that these values vary depending on their frequency range. For example, an SSVEP at 37 Hz has larger amplitude than another SSVEP at 40 Hz. In order to compute P(fi), O1, Oz and O2 channels were used, consequently M = 3. This calculation was performed every 0.25 s.

An SSVEP is labelled as one of the four possible classes (top, right, down or left) if the maximum P(fi) is maintained for a determined period of time H:

(3)

The time-threshold H in time-locked (synchronous) step is H S and fixed at 1.75 s for on-line feedback. In asynchronous step H A can be adjusted from 1.5 s to 2.25 s.

Results

Table 1 shows the results in time-locked step for different H S values and are detailed the Correct, Incorrect and Non-detected trials, average time by trial and the Information Transfer Rate (ITR). The ITR is a measure of the information transmitted and is calculated as [18]:

Table 1 Results in time-locked step
(4)

where P r is the probability of non-detected cases, P w is the probability of incorrect detected cases and N is the number of targets (in our case N = 4). The ITR could be expresed in bits/trial or in bits/min.

In asynchromous mode, the SSVEP-power calculated on-line for Subject 5 is presented in Figure 3a. The SSVEP-power increases when the subject gazes at a determined ligth and SSVEP-power is labeled as a class when time-threshold H A is overcome, i.e., the ball changes its movement. In this case H A was 2.25 s.

Figure 3
figure 3

A trial in the hard scenario. (a) power calculated on-line, (b) Direction changes (c) Path followed through the scenario. The direction changes are marked by letters. In t = 64 the ball stops due to a FP (H point).

Figure 3b shows the direction changes along the task. In t = 64 s the ball stops since the top-ligth is detected at this moment (the contrary to current direction), this detection was considered as a FP. Threshold H A was adjusted for each subject in order to reject FP, although some FP were detected anyway, but adjusting to optimal H A the FP rate was lower. Figure 3c shows the path followed by the ball to reach the final spot (white square).

Table 2 presents the results for each subject moving the ball in difficult scenarios. This table, details the mean and standard deviation values of the task time and the number of decisions made to accomplish the task and the TP and FP (and its percentages). The last column on this Table is the number of times that the subject performs the task and when he/she reaches the final destination. It shows the best H A for each subject as well. Finally, when subject is gazing the centre of the screen (looking the moving ball) most of the time, no classes (top, right, left or down) should be detected. Occasionally, if an SSVEP is detected in this situation, it is considered as a FP (see Tables 1 and 2).

Table 2 Average values on difficult scenario

Discussion

Ongoing EEG classification of SSVEP (no high-frequency) based-BCI is implemented in [6, 7] using a refractory time (when no decisions are allowed), in order to control grasping with a robotic arm. This refractory time is implemented to avoid FP since the robotic arm takes a time to perform each movement. In our case the subjects can make decisions every time they want to and the FP are avoided (or diminished) by adjusting the time-threshold H.

Other methods used for high-frequency SSVEP detection are more expensive computationally [9, 1113], and they are evaluated in off-line analysis of the EEG but they were not evaluated for asynchronous EEG classification. Using spatial filters, an ITR of 22.7 bits/min was reached in [13].

A method to control a mobile robot in indoor environments was presented in [18], but the subjects need a few days of training to control the mobile robot. In this case, the subject can control the mobile object on the screen in only a few minutes. This is an advantage of SSVEP based-BCI over other kinds of BCI.

The proposed method achieves accuracy in classification ranging from 65% to 100%. This could be translated into ITR ranging from 9.4 to 45 bits/min. A high bit rate is not required to control a mobile object, since it is not necessary to make decisions every second, e.g., when it navigates through a corridor. Hence the ITR achieved in this research is more than enough to control a mobile object. This is claimed since the subjects can almost always effectively navigate the mobile ball to the final spot most of the time.

In locked-time step, for lower time-threshold H S higher wrong cases were obtained (Table 1); when H S is increased these wrong cases were evaluated as non-detected whereas correct cases were not as detrimental. Therefore, adjusting H S is possible to reduce the wrongly-detected cases and to obtain similar accuracy in detection of SSVEP. If H S parameter overcome a certain value (depending on each subject) it will eventually be unable to detect a class (top, right, down or left) because it is more difficult maintain a SSVEP for long periods of time.

In asynchronous mode, easy and medium scenarios were used to adjust the time-threshold H A , and then the performance of each subject was evaluated in the difficult scenario. Besides, in both of these scenarios the subject learns how to control the ball since it is a hard task, i.e., when to gaze at the light in order to change the movement of the ball at the right time and avoid hitting a wall. For this purpose, those scenarios were repeated a few times (no more than 5 ± 2 in average), depending on the Subject performance.

Moreover, sometimes the subjects did not want to convey any command to the moving ball, however lights are still in their visual field and a command could be detected and transmitted to the ball. This problem is called the "Midas Touch Effect" [19] and this is the reason for the FP. This effect became evident when the moving ball was navigated close to the sides of the screen where the lights are located.

In order to mitigate this effect an adjustable time-threshold H A was implemented. With short time-threshold more FP were attained and the navigation of the ball became unstable. On the other hand, with long time-threshold H A less FP were attained but it was harder to change the movement. Hence, for each subject the time-threshold was adjusted in order to obtain a comfortable navigation of the ball. The time-threshold was adjusted from 1.75 s up to 2.25 s, depending on the subject. The threshold H A in Table 2 is not necessarily the same H S that allows the best ITR in Table 1, since they are evaluated under different experimental conditions. In Table 1, the experiment is in synchronous mode, whereas in Table 2, the experiment is in asynchronous mode and the threshold H A is adjusted in order to get a comfortable navigation of the ball (avoiding, as much as possible, the Midas touch effect).

The threshold H A in asynchronous step was 2 or 2.25 s (see Table 2), hence H A could be used in a fixed value of 2.25 s (the subjects with H A = 2 s could navigate the ball with H A = 2.25 s without performance detriments). However, always is advisable to adapt the BCI in order to attain the optimum performance.

Once the time-threshold was adjusted, subjects had to control the ball in the difficult scenario and navigate it to the final spot. They accomplished this work in almost all cases (except one time in Subjects 4 and 5). The subjects who obtained low ITR in the time-locked step accomplished the work too, however they needed more time than subjects with high ITR.

All subjects participated in this study were asked about discomfort with flickering, no one express discomfort. According with others studies [10, 12, 15], we observe that high-frequencies SSVEP produce much less visual fatigue than lower frequencies. Furthermore, the discomfort of subjects observed in a previous work of our group [17], using SSVEP in medium frequency range (13 to 16 Hz), was less compared to this work.

In summary, the asynchronous BCI proposed in this work allows the effective control of a mobile object on the screen with high-frequency SSVEP (which are less annoying) and using a simple method to extract SSVEP from ongoing EEG.

Conclusions

In this work, an asynchronous BCI based in high-frequency SSVEP is presented, using only three ongoing EEG channels in order to control a mobile object on the screen. Besides, it used a simple method to detect the SSVEP, i.e., mean powers of each stimulation frequency evaluated on the periodogram. It obtained accurate classification among 65% to 100% with ITR ranging from 9.4 to 45 bits/min.

This method allows to all subjects participating in the study to control the mobile object and to reach a final target without training, by only adjusting one parameter, the time-threshold H. Furthermore, impaired people could be benefit from this method since it could be easily extended to control a robotic wheelchair.

Written informed consent was obtained for publication of this case report and accompanying images. A copy of the written consent is available for review by the Editor-in-Chief of this journal.

References

  1. Regan D, Human Brain Electrophysiology: Evoked Potentials and Evoked Magnetic Fields in Science and Medicine. New York: Elsevier; 1989.

    Google Scholar 

  2. Vialatte FB, Maurice M, Dauwels J, Cichocki A: Steady-state visually evoked potentials Focus on essential paradigms and future perspectives. Progress in Neurobiology 2010, 90: 418-438. 10.1016/j.pneurobio.2009.11.005

    Article  PubMed  Google Scholar 

  3. Herrmann CS: Human EEG responses to 1-100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena. Exp Brain Res 2001, 137: 346-353. 10.1007/s002210100682

    Article  CAS  PubMed  Google Scholar 

  4. Wang Y, Wang R, Gao X, Hong B, Gao S: A Practical VEP-Based Brain-Computer Interface. IEEE Trans on Neural Syst Rehab Eng 2006,14(2):234-239. 10.1109/TNSRE.2006.875576

    Article  CAS  Google Scholar 

  5. Valbuena D, Volosyak I, Gräser A: sBCI: Fast Detection of Steady-State Visual Evoked Potentials. Proceedings 32nd Annual Int Conf IEEE EMBS: August 31-September 4, 2010; Buenos Aires, Argentina 2010, 3966-3940.

    Google Scholar 

  6. Ortner R, Allison BZ, Korisek G, Gaggl H, Pfurtscheller G: An SSVEP BCI to control a hand orthosis for persons with tetraplegia. IEEE Trans Neural Syst Rehabil Eng 2011,19(1):1-5.

    Article  PubMed  Google Scholar 

  7. Müller-Putz GR, Pfurtscheller G: Control of an Electrical Prosthesis With an SSVEP-Based BCI. IEEE Trans Biomed Eng 2008,55(1):361-364.

    Article  PubMed  Google Scholar 

  8. Friman O, Volosyak I, Gräser A: Multiple Channel Detection of Steady-State Visual Evoked Potentials for Brain-Computer Interfaces. IEEE Trans Biomed Eng 2007,54(4):742-750.

    Article  PubMed  Google Scholar 

  9. Nielsen SS: Communication speed enhancement for visual based Brain Computer Interfaces. Proceedings 9th Annual Conf Int FES Society: September 2004, Bournemouth, UK 2004.

    Google Scholar 

  10. Materka A, Byczuk M, Poryzala P: A Virtual Keypad Based On Alternate Half-Field Stimulated Visual Evoked Potentials. Proceedings Int Symposium on Information Technology Convergence (ISICT 2007): 23-24 Nov 2007; Jeon Ju, Korea; 2007, 296-300.

    Chapter  Google Scholar 

  11. Lin Z, Zhang C, Wu W, Gao X: Frequency Recognition Based on Canonical Correlation Analysis for SSVEP-Based BCIs. IEEE Trans Biomed Eng 2007,54(6):1172-1176.

    Article  PubMed  Google Scholar 

  12. Huang M, Wu P, Liu Y, Bi L, Chen H: Application and Contrast in Brain-Computer Interface between Hilbert-Huang Transform and Wavelet Transform. Proceedings 9th Int Conf for Young Computer Scientists(ICYCS 08), Zhang Jia Jie, Hunan, China 2008, 1706-1710.

    Google Scholar 

  13. Garcia Molina G, Mihajlovic V: Spatial filters to detect steady-state visual evoked potentials elicited by high frequency stimulation: BCI application. Biomed Tech 2010, 55: 173-182. 10.1515/BMT.2010.013

    Article  Google Scholar 

  14. Zhu D, Bieger J, Garcia Molina G, Aarts RM: A Survey of Stimulation Methods Used in SSVEP-Based BCIs. Computational Intelligence and Neuroscience (Hindawi Publishing Corp) 2010, Art ID 702357 1-12.

    Google Scholar 

  15. Wang Y, Wang R, Gao X, Gao S: Brain-computer Interface based on the High-frequency Steady-state Visual Evoked Potential. Proceedings 1st International Conference on Neural Interface and Control Proceedings, May 2005, Wuhan, China 2005, 26-28.

    Google Scholar 

  16. Fisher RS, Harding G, Erba G, Barkley GL, Wilkins A: Photic-and pattern-induced seizures: A review for the epilepsy foundation of america working group. Epilepsia 2005,46(9):1426-1441. 10.1111/j.1528-1167.2005.31405.x

    Article  PubMed  Google Scholar 

  17. Diez PF, Mut V, Laciar E, Avila E: A Comparison of Monopolar and Bipolar EEG Recordings for SSVEP Detection. Proceedings 32nd Annual Int Conf IEEE EMBS August 31-September 42010, Buenos Aires, Argentina; 2010, 5803-5806.

    Google Scholar 

  18. Millán J, del R, Renkens F, Mouriño J, Gerstner W: Noninvasive Brain-Actuated Control of a Mobile Robot by Human EEG. IEEE Trans Biomed Eng 2004,51(6):1026-1033. 10.1109/TBME.2004.827086

    Article  Google Scholar 

  19. Moore MM: Real-world applications for brain-computer interface technology. IEEE Trans on Neural Syst and Rehab Eng 2003, 11: 162-165. 10.1109/TNSRE.2003.814433

    Article  Google Scholar 

Download references

Acknowledgements

PFD, VAM and ELL are supported by Consejo Nacional de Investigación Científica y Tecnológica, CONICET (National Council for Scientific and Technological Research).

Authors would like to thank to subjects for participating in these experiments and to anonymous reviewers for their helpful comments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pablo F Diez.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

PFD wrote the algorithms and performed the experiments with help from EAP. VAM and ELL contributed with initial ideas and advisory. All authors reviewed and approved the final manuscript.

Electronic supplementary material

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Diez, P.F., Mut, V.A., Avila Perona, E.M. et al. Asynchronous BCI control using high-frequency SSVEP. J NeuroEngineering Rehabil 8, 39 (2011). https://doi.org/10.1186/1743-0003-8-39

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1743-0003-8-39

Keywords