- Open Access
Time-frequency analysis of band-limited EEG with BMFLC and Kalman filter for BCI applications
Journal of NeuroEngineering and Rehabilitation volume 10, Article number: 109 (2013)
Time-Frequency analysis of electroencephalogram (EEG) during different mental tasks received significant attention. As EEG is non-stationary, time-frequency analysis is essential to analyze brain states during different mental tasks. Further, the time-frequency information of EEG signal can be used as a feature for classification in brain-computer interface (BCI) applications.
To accurately model the EEG, band-limited multiple Fourier linear combiner (BMFLC), a linear combination of truncated multiple Fourier series models is employed. A state-space model for BMFLC in combination with Kalman filter/smoother is developed to obtain accurate adaptive estimation. By virtue of construction, BMFLC with Kalman filter/smoother provides accurate time-frequency decomposition of the bandlimited signal.
The proposed method is computationally fast and is suitable for real-time BCI applications. To evaluate the proposed algorithm, a comparison with short-time Fourier transform (STFT) and continuous wavelet transform (CWT) for both synthesized and real EEG data is performed in this paper. The proposed method is applied to BCI Competition data IV for ERD detection in comparison with existing methods.
Results show that the proposed algorithm can provide optimal time-frequency resolution as compared to STFT and CWT. For ERD detection, BMFLC-KF outperforms STFT and BMFLC-KS in real-time applicability with low computational requirement.
EEG uses electrodes to record electrical brain activity that originates from the post-synaptic potentials, aggregates at the cortex, and transfers through the skull to the scalp. The EEG signal is the reflection of brains neuronal oscillations. These oscillations with similar frequency and energy lead to the separation of frequency bands . Numerous studies have tried to identify the relation between the frequency bands and brain states and it still remains as a hotspot of ongoing neuroscience research [2, 3]. EEG activity related with voluntary movements has been the center of interest, as it is applicable to brain-computer interfaces (BCI) [4–8].
Several BCI systems rely on an amplitude attenuation phenomenon, namely event-related desynchronization (ERD) that can be voluntarily controlled by movement imagery. It was shown in  that during both planning and execution of hand movements, the ERD can be detected in most of the subjects within the band of μ-rhythm (6-14 Hz). By utilizing this amplitude attenuation phenomenon, an alternative communication pathway can be built directly from human brain to the computer . The accuracy of this class of methods was examined in . In recent years, this type of BCIs has been applied for limb function recovery  and robotic system control , which can improve the quality of life of the subject with severe motor function impairment. The energy decrease in ERD usually occurs in a specific frequency band for a subject. When the frequency characteristics of signal are required, the fast Fourier transform (FFT) is often used. For BCI applications, the ERD in the EEG signal is considered as a percentage change of the signal amplitude with respect to a experiment cue [9, 11–13]. Since the FFT-based methods cannot provide time-frequency information, the time-frequency representation (TFR) of EEG signal is extremely important for ERD analysis.
As the performance of EEG-based BCI systems rely on the time-domain and frequency-domain features, a variety of EEG features (such as power spectrum within a pre-defined frequency band  and phase lock value ) that reflects ongoing brain states have been attempted for designing BCI systems. In general, the feature extraction algorithm requires accumulation of sufficient number of samples for generating control commands. In , an EEG-based BCI for three-dimensional movement control has been implemented where the power spectrum was calculated for every 50 ms with a 16-order autoregressive(AR) model. In a recent research , BCI with a noninvasive functional electrical stimulation has been studied. In the on-line processing phase, the BCI aggregates 500 ms EEG signal and then FFT is applied to obtain power estimates for classification. It is clear that the response time of BCIs mainly depends on the time required by the feature extraction algorithm to store and process a sufficient number of samples. Since power spectrum is a frequency domain feature, the time-frequency representation(TFR) methods that can provide amplitude variation along time axis, can be directly applied to BCI systems. Furthermore, the accuracy of BCIs can be improved by employing a narrow subject-specific frequency band [9, 18, 19]. In , an adaptive filtering approach was employed for identifying the subject-specific frequency band to improve the classification accuracy.
The TFR methods can be categorized into two types, namely non-parametric and parametric methods. The non-parametric TFRs such as band-pass filtering, short time Fourier transform (STFT) and continuous wavelet transform (CWT) were successfully applied in time-frequency analysis of EEG [20, 21]. However, all the traditional methods have pros and cons in temporal and spectral resolutions. In band-pass filtering, the temporal and spectral resolution is highly dependent on the filter type, center frequency of the filter and its order. The temporal and spectral resolution of STFT is determined by the window length. The CWT can be considered as the best TFR technique among the available methods. However, it still suffers with the tradeoff between temporal and spectral resolution as STFT. The computational requirement of CWT remains as a major barrier for real-time BCI applications. A performance comparison of all the TFR methods for EEG time-frequency analysis can be found in .
Recently, a new method band-limited multiple Fourier linear combiner (BMFLC) was developed for estimating band-limited signals within a pre-defined frequency band . By incorporating the idea of linear time varying model with a fixed frequency band, BMFLC can provide an alternative spectral estimation method for band-limited signals. The original BMFLC adopted a truncated Fourier series as the model and estimated the Fourier coefficients by least mean squares (LMS) algorithm [23, 24]. As LMS requires time to converge to the steady-state, the algorithm accuracy cannot be guaranteed for small data segments. Especially, LMS algorithm is not suitable when the main objective is to accurately track the amplitude changes of a band-limited signal. To improve the accuracy of the time-frequency decomposition and the tracking ability of the existing BMFLC for real-time applications, Kalman Filter is employed. The proposed method is designed to extract time-frequency amplitude distribution that is more suitable for BCI applications. The performance of proposed method is evaluated in comparison with STFT, CWT and the existing BMFLC-LMS method.
This section first reviews the existing methods for time-frequency representation and later presents the proposed methods.
Classical time-frequency methods
As the traditional fast Fourier transform (FFT) does not provide time-domain information, the intuitive way to overcome this is to isolate the signal in time domain by multiplying with a window function and compute the Fourier coefficients in that time interval, then shift the time window through the time line to capture the entire time-frequency information of the signal .
In , the time-frequency resolution of STFT is interpreted by the Heisenberg uncertainty principle. It asserts that the temporal and spectral resolutions cannot be guaranteed at the same time and the joint time-frequency resolution has a lower bound given by
It can be illustrated as a box centered at (t,ω), with the length equal to △t in time domain and the width equal to △ω in the frequency domain, to sweep the whole time-frequency domain to extract the time-frequency information. Since this product remains constant, the increase of one quantity will cause degradation in the other. This degradation (leakage effect) is also due to this constant product. Thus the information that can be extracted via STFT is actually the information within that box. If the window function has a Gaussian envelope, the STFT can achieve the lower bound defined in (1) . The STFT with a Gaussian window function is commonly referred as Gabor transform.
In STFT, after fixing the length of the window function, its time-frequency resolution remains constant for the entire time-frequency domain. The continuous wavelet transform (CWT) solves this problem by adopting a dilated and translated versions of the same function namely, the mother wavelet [26, 27]. The dilated version of the mother wavelet is controlled by a scalar parameter a in CWT, where the corresponding time-frequency resolution can be provided as . Although the time-frequency resolution is still bounded by Heisenberg uncertainty, but the length and width are scaled by the parameter a. Therefore, for CWT the time-frequency resolution can be adjusted by the parameter a compared to a fixed time-frequency resolution in STFT.
If the mother wavelet is a complex function, then the CWT is also known as complex CWT which is widely used in EEG signal processing [12, 22, 28]. Similar to STFT, the joint time-frequency resolution is optimized by a mother wavelet that has Gaussian envelope . Morlet wavelet is one of them and is defined as :
where ω0 defines the oscillation of the mother wavelet. The term in (2) is a correction term employed to satisfy the admissibility condition. If a sufficiently large ω0 is adopted, e.g. ω0>5, then the term can be neglected. The joint time-frequency resolution can achieve its lower bound with △t=0.707 and △ω=0.707 . For Morlet wavelets that have a dominant periodic component, the relationship between scale and Fourier frequency  can be obtained as
where f and a represent the Fourier frequency and wavelets scale respectively.
The STFT and CWT belong to the analytic time-frequency representation methods, where the time-frequency resolution has a lower bound that is determined by the Heisenberg uncertainty. To apply the CWT and STFT to a signal, an appropriate length of the signal is required, as all the samples within the window function should be used at each time-frequency decomposition. The power spectrum defined in STFT and CWT is relative to the true signal spectrum that can be obtained from FFT. For some applications where the exact measurement of amplitude or power at a specific frequency is required, the CWT and STFT are not suitable.
Band-limited multiple Fourier linear combiner
The Fourier linear combiner (FLC) proposed in  works by adaptively estimating the Fourier coefficients of a known base frequency together with its harmonics with the help of the least mean squares (LMS) algorithm. In [18, 23], to estimate the unknown band-limited signal, a pre-defined frequency band [ ω1-ω n ] is considered and divided into ‘n’ finite number of divisions. Then n-FLC’s are combined to form the BMFLC to estimate bandlimited signals. The frequency resolution of BMFLC, (i.e.), is the frequency gap between two adjacent frequency components. The selection of frequency gap is a balance between signal characteristics and analysis requirement.
where y k denotes the estimated signal at sampling instant k. a r k and b r k represents the adaptive weights corresponding to the frequency ω r at time instant k. The frequency components x k and the corresponding adaptive weights w k can be written in the matrix form as:
By employing LMS algorithm , the estimation of Fourier coefficients can be achieved by computing the following recursive equation:
where ε k is the error between modeling and measurement and μ is adaptive gain of LMS. As LMS algorithm relies on gradient based method for error minimization, the accuracy of the algorithm can be affected by the dynamic changes in the characteristics of the signal. LMS algorithm has only a single adjustable parameter for controlling the convergence rate, namely, the adaptive gain μ. Selection of proper μ is very important for stability and convergence of the algorithm. For difference choices of frequency gap (△f), different values of μ are required to ensure stability and convergence . As shown in , BMFLC-LMS requires around 5 seconds for the initial weights to track the amplitude changes in a 25s EEG signal. For the practical BCI systems, the length of EEG signal is generally in a few seconds after the experiment cue. To improve the performance, we employ Kalman Filter (KF).
BMFLC with Kalman filter (BMFLC-KF) for real-time estimation
The BMFLC signal model can be rewritten in the condensed form as
where x k and w k are defined in (5) and (6). Clearly, this is a linear model with x k being the frequency component at each time step k and v k the observation error. Together with (5) and (6), and the output Equation (9), we have the state-space form for the BMFLC. The architecture of the proposed algorithm is illustrated in Figure 1.
The adaptive vector w k in this model is considered to be state vector. The variation of the state when no priori information is available is typically described with the random walk model . The state equation can now expressed as
where η k is the state error.
We assume that the measurement error v k and state error η k are uncorrelated, zero mean, Gaussian white noise processes and are denoted as
where R and Q are measurement error covariance and state error covariance respectively. By employing the Kalman filter, the optimal estimation of the state of the dynamical system at time instant k can be obtained with the measurement sequence Y1: k-1=[y1,y2,⋯,yk-1] where y k is the output defined in (4). Although the premise of the noise may not hold for the signal to be analyzed, it was shown in [35, 36] that Kalman filter can also provide the minimum mean-squared error estimation within the class of linear estimators. The adaptive algorithm together with the BMFLC is shown in Figure 1.
Throughout this section, we employ the the following notation:
where E[ w k |yk-1] denotes the mathematical expectation of w at time instant k with respect to previous observation y at k-1. Given the measurement sequence Y1: k-1, the estimated state along with the estimated state error covariance P k ) can be obtained with the Kalman filter as:
with initial condition , P0. K k is the Kalman gain updated at each time instant. The BMFLC-KF does not require the matrix inverse as it only involves a scalar observation. The proposed BMFLC-KF is computationally fast and is well suited for real-time applications.
BMFLC with Kalman Smoother (BMFLC-KS) for off-line analysis
Furthermore, if the future measurements Yk+1: N are available, they can be used to improve the accuracy of the state estimation. Hence the estimator is named as a smoother. In this paper, we adopt a fixed-interval smoother to improve the state estimation accuracy. The fixed-interval smoothing problem is to find the minimum mean square estimator for each state w k (k=1,⋯,N) given the observations y1,⋯,y N . The smoothed estimator denoted by can be obtained as follows :
where and are estimated through recursion with the Kalman filter. The smoother estimation is then obtained by running the stored estimates backward in time. This procedure is suitable for off-line analysis.
The convergence properties of the proposed method are determined by the Kalman filter. The convergence analysis for autoregressive(AR) model with Kalman filter was well documented in [37–40]. It was shown in  that the Kalman filter is uniformly exponentially stable, if the output matrix sequence and the covariance of state error are bounded. In proposed method, the output matrix in (9) is a combination of user-defined frequency components. As sine and cosine functions are bounded, the output matrix is bounded. The covariance of state error is user-defined and is bounded. Hence the convergence of proposed algorithm can be established similar to . Further the convergence rate can be quantified as in .
Time-frequency decomposition with BMFLC
Based on (9) and (10), the weight vectors of BMFLC represents the Fourier coefficients of the band-limited signal. We can combine the weights into the following form:
where is the absolute weight vector of the frequency components at time instant k. The absolute time-frequency weights decomposed matrix D can be obtained for the signal with m samples as
where each row vector presents the amplitude variation of a single frequency component at each time instant k. The energy distribution in the time-frequency mapping can be obtained as
where the operator ⊙ represents the element by element multiplication of the matrix. The D matrix provide the time-domain information of all individual frequency component and it can be directly used for time-frequency representation.
Comparing with the LMS based BMFLC in [18, 32], by adopting the Kalman filter combined with the smoother procedure, an accurate weights adaption process in BMFLC can be achieved. Hence it provides an accurate time-frequency decomposition. The usage of smoother is optional and it depends on the purpose of analysis. For the off-line analysis, if an accurate time-frequency mapping is required, the smoother procedure can be employed.
In order to compare the temporal and spectral resolutions, three synthesized signals are used in this study. Since EEG μ-band (6-14)Hz is of special interest, three synthesized signals are chosen to contain the frequency components within this frequency band. The first synthesized signal is defined as:
and is illustrated in Figure 2(a1). The signal has discontinuities in frequencies and has both amplitude and frequency modulations. This signal is used to test the frequency resolution and tracking ability of the algorithm. The second synthesized signal is defined as
and is shown in Figure 2(b1). The sudden burst in the signal is well-suited to test the temporal resolution of the method. To further analyze the spectral resolution capabilities of all the methods, a signal with four closely spaced frequency components is chosen as
For the analysis of steady-state behavior of BMFLC based methods, an extended version of signal S1 is chosen as
The EEG data set used in the study is from Brain Computer Interface Competition IV . The set contains EEG data of 9 subjects. EEG was recorded from 22 Ag/AgCl electrodes sampled at 250 Hz. All signals were recorded monopolarly with the left mastoid as reference and right mastoid as ground. Four classes of cue-based motor imagery tasks were carried out, namely the imagination of movement of the left hand, right hand, both feet and tongue. Each subject data was recorded in 2 sessions on separate days. Each session consists of 6 runs separated by short breaks. One runs consists of 48 trials. During the recording, the subjects sat on a comfortable armchair in front of a computer screen. At the beginning of each trial (t=0s), a fixation cross appeared on the black screen. Two seconds later, a cue in the form of an arrow pointing either to the left, right, down or up displayed on the screen and lasted 1.25s. The subjects were asked to perform the motor imagery task until the fixation cross disappeared from the screen at t=6s. The sequence is shown in Figure 3 (reproduced from ). For more details about data collection, see . In this paper the hand movement imagery is considered. For the hand movement imagery, EEG data from the electrodes C3 and C4 placed over the sensorimotor cortex according to 10/20 international system, where the μ-rhythm originates, is selected for analysis. To limit the analysis to μ-band, the data was filtered between 6 Hz and 14 Hz by a fifth-order Butterworth bandpass filter.
To quantify the performance of BMFLC based algorithm, we employ the root mean square defined as where n and s are the number of samples and input signal respectively. s k denotes the input signal at time instant k. The percentage accuracy is defined as
where e is the estimation error.
For estimation of synthesized signals and EEG, we set the following parameters for BMFLC based algorithms: f1=6 Hz, ω1=2π f1,f n =14 Hz, ω n =2π f n . Frequency spacing is set to be △f=0.5 Hz . The weights are initialized with 0, i.e. w0=0. For the BMFLC-LMS algorithm, the adaptive gain μ=0.035 is chosen for optimal performance for the corresponding frequency spacing △f=0.5 Hz . The co-relation between the parameter μ and step-size is discussed in .
For implementation of BMFLC-KF/KS, the two parameters, the state noise covariance Q and measure noise covariance R should be properly tuned. In the following, several experiments are conducted for identification of parameters to achieve better accuracy. To start with, we assume that the state noise covariance is a diagonal matrix in the form of Q=q∗I. Then the parameter q is selected such that the root-mean-square (RMS) error is minimized. In , the measurement noise covariance R was estimated online by using the innovation process of the Kalman filter. Then an optimal value for q is selected to minimize the RMS error. Further, the selection of q is also performed for pre-fixed R. Experiments are first performed with synthetic signal S1 and S2 and the corresponding results are shown in Figure 4(a) and 4(b). It shows that when q>0, the RMS error is below 3% when R is estimated online and 1% for pre-fixed R. Based on the result of earlier experiment, we initialize q=0.05 and then optimize R. The results obtained for signal S1(t) are shown in Figure 4(c). As we vary the value of R, the RMS error remains constant. This further shows that the error performance of BMFLC-KF/KS is highly dependent on the selection of q.
To further justify the selection of parameters, experiments are conducted with the EEG data. EEG data of all trials of subject 1 are selected. Similar to the earlier, R is estimated in the algorithm, and the q is selected based on the RMS error. Based on the RMS error obtained for all selections of q and for all trials of the subject #1, the 95% confidence interval (CI) is estimated. To obtain reliable estimation of CI, Bootstrap method  with 2000 re-sampling is employed and the results are shown in Figure 4(d)-(e). Hence, we select q=0.01 and R=0.01 for optimal performance.
The STFT and CWT are set to have the same frequency resolution as BMFLC. The window function in STFT is set according to
where L denotes the length of the window function, F s is the sampling frequency and △f=△ω/2π. The step size of STFT is 1/F s . For the wavelet-based TFR method, the Morlet wavelet is employed with ω0=6 to offer good trade-off between temporal and spectral resolutions . A total of 17 scales are calculated in this paper, which are equally spaced within the range of 6H z to 14H z with the same frequency gap employed in BMFLC and STFT. The wavelet scale is transformed to Fourier frequency with (3).
In this section, we provide comprehensive analysis of all the five methods, BMFLC-LMS, BMFLC-KF, BMFLC-KS, STFT and CWT for synthetic and EEG data sets discussed in earlier section.
To compare the estimation accuracy of BMFLC based methods, the estimated signal together with the estimation error for synthesized signals (23, 24) and single trial EEG data (C3 electrode for right hand movement imagery) are shown in Figure 2.
In Figure 2(a2) and Figure 2(b2), error can be observed at the transition points for BMFLC-KF. By comparing the results of BMFLC-LMS in Figure 2(a4) and BMFLC-KF/KS in Figure 2(a2) and (a3), it is clear that the estimation accuracy depends on the adaptive algorithm. For the EEG data, BMFLC-KF/KS performed better compared to BMFLC-LMS as shown in Figure 2(c4).
For BMFLC-KS, the error is backward averaged to obtain the smoothed estimation. Since the system transition matrix is modelled as identity matrix, the accuracy of the algorithm cannot be improved with Kalman-smoother . However, we can observe from Figure 2(b2) and Figure 2(b3) that the transient performance can be improved.
The RMS% error for all methods is tabulated in Table 1. The results indicate that the proposed method accurately models both the synthesized signals and EEG data. For a large EEG data set, the accuracy remained nearly constant with small variation.
To analyze the effect of frequency gap on estimation accuracy, the RMS% accuracy for all methods for various choices of frequency gap is computed with 68 trials of EEG data (C3_RH_All). Table 2 shows that the choice of frequency gap does not effect the accuracy of the estimation. However, the selection of frequency gap affects the frequency tracking that can be obtained from BMFLC. This issue will be discussed in the following section.
Temporal and spectral resolution: comparison of all five methods
The time-frequency representation of two synthesized signals together with the single trial EEG data obtained with STFT, CWT and BMFLC based methods are shown in Figure 5. The leakage effects of STFT and CWT can be clearly identified (Figure 5(a5), (b5), (a6) and (b6)) in the adjacent frequency components. The colorbar represents the absolute amplitude of corresponding frequency components in the figure for BMFLC-LMS, BMFLC-KF/KS. By construction, BMFLC models the signal into individual frequency components and hence the leakage effect that occurs in STFT and CWT can be mitigated.
BMFLC-KF provides accurate spectral estimation as shown in Figure 5(a2) and (b2). However, when there is a sudden change in the frequency, BMFLC-KF requires an adapting period for tracking the spectral changes in the signal. Although the estimation accuracy is high, there is some disturbance at the frequency transition at 5 sec as seen in Figure 5(a2) and (b2). As the amplitude weights of BMFLC-KF are initialized with zero, BMFLC-KF requires an initial adaptation period. This is mainly due to the random walk model employed for the state transition in BMFLC. By comparing Figure 5(a2) with Figure 5(a3) and Figure 5(b2) with Figure 5(b3), the estimation of smoother relays on the information provided by the Kalman filter, and operates backward to smooth the errors in the estimation. It is clear that the BMFLC-KS provides improved spectral estimation.
Another factor that affects the spectral estimation is the selection of frequency gap Δ f. To study the sensitivity of the method, synthesized signal S3(t) is employed and the results for various Δ f are shown in Figure 6. When source signal has several frequency components located closely in the spectral domain, STFT provides better spectral estimation compared to CWT. It is also clear that, with STFT the estimated amplitude is distorted. A frequency gap of 0.2 Hz is employed for the analysis with BMFLC based methods. For a frequency gap Δ f=0.1 Hz and 0.2 Hz, spectral estimation obtained with BMFLC-KF/KS is better compared to STFT. With BMFLC-KS the initial adaptation period is reduced and the improved performance can be seen in Figure 6(d). As the source signal S3(t) has closely spaced frequencies, the results for BMFLC with frequency gap 1 Hz are not accurate as shown in Figure 6(h). Furthermore, the number of frequency weights in BMFLC based methods can affect the amplitude estimation. As shown in Figure 6(g), when Δ f=0.1 Hz gap is used, the estimated amplitude is smaller compared to the actual amplitude of the synthesized signal S3(t). These results clearly shows that the an appropriate frequency gap should be selected for accurate spectral estimation.
The inadequacy of CWT for the synthetic signal S3(t) in Figure 6(f) is mainly due to the parameter selection of the mother wavelets. The bigger the ω0 in Morlet wavelets, the better frequency resolution can be obtained. By proper tuning of ω0, an improved spectral resolution can be obtained for S3(t) as shown in Figure 7(a). However, for the same parameter selection, the CWT for the signal S2(t) is shown in Figure 7(b) and the temporal resolution is compromised. It is clear that if high accuracy is required in the spectral domain, accuracy in the temporal resolution cannot be guaranteed at the same time. Comparing the above results, BMFLC method provides better frequency resolution without loss of temporal resolution.
Although the amplitude accuracy of BMFLC-LMS is high, its corresponding frequency components cannot adjust to the sudden changes in the frequency characteristics of the signal. The weights of BMFLC-LMS requires longer duration to track the changes in the frequency characteristics of the signal. To highlight the problem, synthesized signal S4(t) is employed. Time-frequency maps for BMFLC-LMS, BMFLC-KF/KS are shown in Figure 8(a). Individual weights of BMFLC are shown in Figure 8(b)-(d). It can be clearly seen in Figure 8(d) that the frequency weights of BMFLC-LMS require more time to settle to steady-state. Whereas BMFLC-KF/KS weights settle to correct frequency values immediately as shown in Figure 8(c)-(d). When the frequency components in signal S4 change at 60s, the previous settled frequency weights slowly decreases to 0 as the new frequency components gradually increase. BMFLC-KF/KS can track the sudden changes in frequency, whereas the corresponding weights in BMFLC-LMS does not settle. This clearly highlight the inadequacy of the BMFLC-LMS for extracting fast changing frequency characteristics in the signal.
In order to study the real-time applicability, the computational complexity of the TFR methods is presented. The difference between BMFLC-KF and non-parametric methods (CWT and STFT) is that they require sufficient length of input samples to be stored in order to provide the time-frequency mapping. Therefore the computational complexity of these methods relies on the length of the input data.
On the other hand, the BMFLC-KF updates the estimation at every sample. Therefore the computational complexity only relies on the observation and state-space dimensions of the Kalman filter and is independent of the input data length. The computational complexity of Kalman filter is given by O(3l n2), where l and n are observation and state-space dimensions respectively . For STFT, the input data is first multiplied with a window function followed by FFT . Hence the computational complexity of STFT is O(N l o g2N), where N is the length of the data being analyzed. The inverse Fourier transform for CWT requires three FFT’s for a signal with length N. Hence the computational complexity of CWT can be computed as O(3N l o g2N). For comparison, the operations required for all methods are tabulated in Table 3.
In BCIs, the feature required for generating a control command is extracted every 500 ms [16, 45]. Let us consider the sampling frequency as F s =512 Hz and frequency resolution as △f=0.5 Hz . For the given △f, the order of BMFLC-KF can be obtained as . In order to maintain the same frequency resolution in STFT and FFT with BMFLC, the data is padded with zeros in order to have sufficient data length (28) for analysis. For quantitative comparison, the operations required for all the methods are for a given data length is also provided in Table 3. The computational complexity of FFT  is also discussed in the Table. This comparison quantifies the computational complexity of the algorithms for real-time implementation. BMFLC-KF has comparatively lower computational requirement compared to other methods.
The computational complexity of BMFLC-KF depends on the dimensions of the state-space which grows linearly as the frequency gap Δ f decreases. The computational requirement of BMFLC-KF for various Δ f are given in Table 4. For a small frequency gap Δ f=0.1 or 0.2, the computational complexity increases and the method becomes impractical for real-time applications. However, for EEG applications with an appropriate frequency gap, i.e. △f=0.5 Hz as in , the BMFLC-KF can be used for BCI applications to provide better spectral resolution with less computation as compared to STFT and CWT.
In order to test the efficiency of the proposed algorithm for BCI applications, we apply all five TFR methods to the EEG data for ERD detection. ERD detection can be identified in two ways. It can be either seen as an energy decreasing with respect to the experiment cue in the time-frequency mapping or as an energy percentage change with respect to a reference period (a pre-defined period before the experiment cue onset). The percentage value denoted as is defined similar to  as
where are the estimated weights from time-frequency decomposition algorithm at j th sample of the i th trial of frequency f, is the mean of weights over all trials and N is the number of trials/subject. Rf is average power in the pre-defined reference period [ r0,r0+k]. The reference period is generally the period before the cue is onset . In line with earlier works [9, 32], we select the reference period as 0 to 1.5 s before the cue onset (cue at 2 sec) for calculation of ERD. The time-frequency map for ERD is obtained by combining all the row vectors , with m being the number of data samples in a given trial. The obtained ERD % is the average over all trials of a subject.
The ERD detection of the corresponding electrode location and all trials for 3 subjects (Subject 1 right hand imagery, Subject 3 right hand imagery and Subject 7 right hand imagery) is shown in Figure 9. ERD pattern can be identified for all the three subjects in different frequency bands for all the methods. Comparing the results of BMFLC-KF (Figure 9(a1)-(c1)) with STFT (Figure 9(a3)-(c3)) and CWT (Figure 9(a4)-(c4)), there is a small delay in the event transition in the ERD pattern. Whereas BMFLC-KS (Figure 9(a2)-(c2)) shows similar performance compared to STFT and CWT. It is clear that BMFLC-KF requires additional 0.5s for the settlement of frequency weights (as depicted in the Figure 9(a1)-(c1) during the initial 0.5 s).
To statistically validate the performance, bootstrap with 2000 times re-sampling is used to estimate the 95% confidence interval for obtained ERD%. As stated in , if both confidence values of an ERD show same sign then it can be considered as significant. The bootstrap test shows that the obtained ERD mapping is significant for all methods.
In order to quantify the ERD, the difference between maximal ERD percentage value and minimal ERD percentage value averaged over all frequency components is analyzed. The results are shown in Figure 10. A z-test has been applied to check whether the results are significantly different among methods. For all the subjects, the CWT shows the highest difference in ERD detection in mean value. The BMFLC-KF performs better than STFT over all the subjects (z=11.12,p<0.01) and it also outperforms BMFLC-KS (z=15.01,p<0.01). The CWT provides the best performance compared to all the four methods.
To highlight the applicability of the proposed method for BCI applications, single trial ERD pattern for subject 3 right hand imagery from C3 location (shown in Figure 11(a1)) was analyzed. ERD for a single trial data can be visually identified as an energy decreasing phenomenon after cue is onset in Figure 11 for all the methods. Since the motor sensory ERD only exists before the movement onset, this phenomenon is extremely sensitive to time delay.
By comparing the results in Figure 11(b2)-(b5), ERD can be observed in the frequency range of 10 Hz- 12 Hz in all the methods except BMFLC-LMS. Within these methods, STFT (Figure 11(b4)) and CWT (Figure 11(b5)) offer the best temporal accuracy. On the other hand, BMFLC-KF/KS also provides narrower band similar to CWT. By comparing the results of Figure 11(b1) and (b2), the adaptation period in Kalman filter can be decreased with the smoother procedure. Also, the frequency transitions in the spectral domain can be accurately estimated in the time-frequency mapping for BCI applications with the proposed method.
Although the proposed method ensures high accuracy for all choices of (Δ f), an optimal selection of (Δ f) is required for real-time implementation. For EEG, a frequency gap of 0.5 Hz is optimal  and ensures accurate spectral estimation. However, for off-line analysis a small (Δ f) can be selected. The comparative study conducted on computational complexity of the TFRs shows that the proposed method has lower computational demand for a bandlimited signal. Hence, the proposed method is more suitable for accurate spectral estimation in a narrow frequency band.
While the proposed method is only discussed for a narrow frequency band in this paper, the method can still be applied for a wide frequency band. Multiple BMFLCs can be implemented in parallel by dividing the wide band into small narrow bands to ensure stability and accuracy for the algorithm. However, if the band of interests is too wide or the frequency resolution for each sub-band is too high, traditional methods would be more appropriate. A wide frequency band increases the computational requirement in BMFLC. As we confine our study to a narrow frequency band, the CWT could not provide better performance compared to STFT as the frequency resolution in CWT is scaled in the narrow band.
Heisenberg uncertainty exists in all the methods. Even though the estimation accuracy is high, the proposed method requires an additional time for the frequency weights to settle, as both amplitude and frequency cannot be estimated at the same time. The uncertainty on frequency can be clearly seen at the sudden frequency or amplitude transition. For EEG signals, an additional 0.5 s is required for the frequency weights to settle. However, it only occurs at the start of the estimation process. This initial estimation delay is inherent for all adaptive based methods and can be improved with proper initialization. The lower computational complexity of the proposed method can offset for the delay caused in the estimation compared to traditional methods. Comparatively, the CWT has the best performance in ERD detection. However, the implementation of CWT method can be a problem for real-time applications.
Although only the ERD detection is considered in this paper as application, the proposed algorithm is applicable for any bandlimited signal estimation. As ERD and ERS (event related synchronization) lies in a specific frequency bands, the proposed method can be applied for ERD and ERS detection simultaneously by employing multiple BMFLC’s in parallel. Since the weights in the BMFLC are directly related to the real amplitudes of the individual frequency components, the algorithm can utilized where an accurate amplitude estimation of a specific frequency component is required.
In this research, the performance of existing BMFLC-LMS is improved by incorporating a Kalman filter. A comparison study of the BMFLC based methods with STFT and CWT is performed with both synthetic and real EEG data. The results indicate that the BMFLC-KF/KS can be used as an alternative time-frequency analysis methods for band-limited signals. As most of the frequency-based BCI applications rely on amplitude features in a fixed frequency band (μ rhythm) for classification, BMFLC-KF can be directly applied to most existing BCI systems. With the linear model employed, optimal estimation can be obtained with the Kalman filter. Thus the proposed method can provide an accurate time-frequency mapping with less computational complexity as compared to STFT and CWT for real-time applications. The results also show that the BMFLC-KS can provide more accurate time-frequency representation for off-line analysis.
Buzsaki G, Draguhn A: Neuronal oscillations in cortical networks. Science 2004, 304: 1926-1929. 10.1126/science.1099745
Olufsen MS, Whittington MA, Camperi M, Kopell N: New roles for the gamma rhythm: population tuning and preprocessing for the beta rhythm. J Comput Neurosci 2003, 14: 33-54. 10.1023/A:1021124317706
Dimitriadis SI, Laskarisb NA, Tsirkac V, Vourkasd M, Micheloyannisc S: What does delta band tell us about cognitive processes: A mental calculation study. Neurosci Lett 2010, 483: 11-15. 10.1016/j.neulet.2010.07.034
Pfurtscheller G, Muller-Putz GR, Scherer R, Neuper C: Rehabilitation with brain-computer interface systems. Computer 2008, 41: 1-8.
Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughana TM: Brain computer interfaces for communication and control. Clin Neurophysiol 2002, 113: 767-791. 10.1016/S1388-2457(02)00057-3
Blankertz B, Losch F, Krauledat M, Dornhege G, Curio G, Muller KR: The Berlin brain-computer interface: accurate performance from first-session in BCI-Naive subjects. IEEE Trans Biomed Eng 2008, 55: 2452-2462.
Ferreira A, Celeste WC, Cheein FA, Bastos-Filho TF, Sarcinelli-Filho M, Carelli R: Human-machine interfaces based on EMG and EEG applied to robotic systems. J Neuroeng Rehabil 2008, 5: 10. 10.1186/1743-0003-5-10
Liu G, Zhang D, Meng J, Huang G, Zhu X: Unsupervised adaptation of electroencephalogram signal processing based on fuzzy C-means algorithm. Int J Adaptive Control Signal Process 2012, 26: 482-495. 10.1002/acs.1293
Pfurtscheller G, Silva FLD: Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin Neurophysiol 1999, 110: 1842-1857. 10.1016/S1388-2457(99)00141-8
Prasad G, Herman P, Coyle D, McDonough S, Crosbie J: Applying a brain-computer interface to support motor imagery practice in people with stroke for upper limb recovery: a feasibility study. J Neuroeng Rehabil 2010, 7: 60. 10.1186/1743-0003-7-60
Pfurtscheller G, Neuper C, Flotzinger D, Pregenzer M: EEG-based discrimination between imagination of right and left hand movement. Electroencephalogr Clin Neurophysiol 1997, 103: 642-651. 10.1016/S0013-4694(97)00080-1
Qin L, He B: A wavelet-based time-frequency analysis approach for classification of motor imagery for brain-computer interface applications. J Neural Eng 2005,2(4):65. 10.1088/1741-2560/2/4/001
Yuan H, Doud A, Gururajan A, He B: Cortical imaging of event-related (de)synchronization during online control of brain-computer interface using minimum-norm estimates in frequency domain. IEEE Trans Neural Syst Rehabil Eng 2008, 16: 425-431.
Herman P, Prasad G, McGinnity T, Coyle D: Comparative analysis of spectral approaches to feature extraction for EEG-based motor imagery classification. IEEE Trans Neural Syst Rehabil Eng 2008,16(4):317-326.
Krusienski DJ, McFarland DJ, Wolpaw JR: Value of amplitude, phase, and coherence features for a sensorimotor rhythm-based brain computer interface. Brain Res Bull 2012, 87: 130-134. 10.1016/j.brainresbull.2011.09.019
McFarland DJ, Sarnacki WA, Wolpaw JR: Electroencephalographic (EEG) control of three-dimensional movement. J Neural Eng 2010,7(3):036007. 10.1088/1741-2560/7/3/036007
Do AH, Wang PT, King CE, Abiri A, Nenadic Z: Brain-computer interface controlled functional electrical stimulation system for ankle movement. J Neuroeng Rehabil 2011, 8: 49. 10.1186/1743-0003-8-49
Veluvolu KC, Wang Y, Kavuri SS: Adaptive estimation of EEG-rhythms for optimal band identification in BCI. J Neurosci Methods 2012, 203: 163-172. 10.1016/j.jneumeth.2011.08.035
McFarland DJ, Wolpaw JR: Sensorimotor rhythm-based brain computer interface (BCI): model order selection for autoregressive spectral analysis. J Neural Eng 2008, 5: 155-162. 10.1088/1741-2560/5/2/006
Pfurtscheller G, Neuper C, Schlogl A, Lugger K: Separability of EEG signals recorded during right and left motor imagery using adaptive autoregressive parameters. IEEE Trans Neural Syst Rehabil Eng 1998,6(NO.3):316-325.
Kiymik MK, Guler I, Dizibuyuk A, Akin M: Comparison of STFT and wavelet transform methods in determining epileptic seizure activity in EEG signals for real-time application. Comput Biol Med 2005, 35: 603-616. 10.1016/j.compbiomed.2004.05.001
Allen DP, MacKinnon CD: Time frequency analysis of movement-related spectral power in EEG during repetitive movements: A comparison of methods. J Neurosci Methods 2010, 186: 107-115. 10.1016/j.jneumeth.2009.10.022
Veluvolu KC, Ang WT: Estimation and filtering of physiological tremor for real-time compensation in surgical robotics applications. Int J Med Robot Comput Assist Surg 2010, 6: 334-342. 10.1002/rcs.340
Latt WT, Veluvolu KC, Ang WT: Drift-free position estimation of periodic or quasi-periodic motion using inertial sensors. Sensors 2011,11(6):5931-5951.
Gabor D: Theory of communication. Electrical Eng - Part III: Radio Commun Eng J Inst 1946, 93: 442-445.
Mallat S: a Wavelet Tour of Signal Processing. Burlington: Elsevier; 2009.
Daubechies I: The wavelet transform, time-frequency localization and signal analysis. IEEE Trans Inf Theory 1990,36(5):961-1005. 10.1109/18.57199
Zhan Y, Halliday D, Jiang P, Liu X, Feng J: Detecting time-dependent coherence between non-stationary electrophysiological signals- A combined statistical and time-frequency approach. J Neurosci Methods 2006, 156: 322-332. 10.1016/j.jneumeth.2006.02.013
Goupillaud P, Grossmann A, Morlet J: Cycle-octave and related transforms in seismic signal analysis. Geoexploration 1984, 23: 85-102. 10.1016/0016-7142(84)90025-5
Aguiar-Conraia L, Soares MJ: The continuous wavelet transform: a primer. NIPE Working Paper Series 2011, NIPE WP 16: 1-46.
Vaz CA, Thakor NV: Adaptive Fourier estimation of time-varying evoked potentials. IEEE Trans Biomed Eng 1989,36(4):448-455. 10.1109/10.18751
Wang Y, Veluvolu KC, Cho JH, Defoort M: Adaptive estimation of EEG for subject-specific reactive band identification and improved ERD detection. Neurosci Lett 2012,528(2):137-42. 10.1016/j.neulet.2012.09.001
Haykin S: Adaptive Filter Theory. Upper Saddle River: Prentice Hall; 2002.
Tarvainen MP, Hiltunen JK, Ranta-aho PO, Karjalainen PA: Estimation of nonstationary EEG with Kalman smoother approach: an application to event-related synchronization (ERS). IEEE Trans Biomed Eng 2004,51(3):516-524. 10.1109/TBME.2003.821029
Shumway RH, Stoffer DS: Time Series Analysis and Its Applications. New York: Springer; 2000.
Simon D: Optimal State Estimation. New Jersey: Wiley; 2006.
Guo L: Estimating time-varying parameters by the Kalman filter based algorithm: stability and convergence. IEEE Trans Automatic Control 1990,35(2):141-147. 10.1109/9.45169
Guo L, Ljung L: Exponential stability of general tracking algorithms. IEEE Trans Automatic Control 1995,40(8):1376-1387. 10.1109/9.402229
Ljung L, Gunnarsson S: Adaptation and tracking in system identification: a survey. Automatica 1990, 26: 7-21. 10.1016/0005-1098(90)90154-A
Cao L, Schwartz HM: Exponential convergence of the Kalman filter based parameter estimation algorithm. Int J Adaptive Control Signal Process 2003,17(10):763-783. 10.1002/acs.774
Brunner C, Naeem M, Leeb R, Graimann B, Pfurtscheller G: Spatial filtering and selection of optimized components in four class motor imagery data using independent components analysis. Pattern Recognit Lett 2007, 28: 957-964. 10.1016/j.patrec.2007.01.002
Graimanna B, Huggins J, Levineb S, Pfurtscheller G: Visualization of significant ERD/ERS patterns in multichannel EEG and ECoG data. Clin Neurophysiol 2002, 113: 43-47. 10.1016/S1388-2457(01)00697-6
Chang DC, Wu WR: Maneuvering target tracking with high-order correlated noise - a multirate Kalman filtering approach. Wireless Pers Commun 2001, 17: 103-123. 10.1023/A:1008965502460
Rockmore D: The FFT: an algorithm the whole family can use. Comput Sci Eng 2000, 2: 60-64. 10.1109/5992.814659
Do AH, Wang PT, King CE, Abiri A, Nenadic Z: Brain computer interface controlled functional electrical stimulation system for ankle movement. J NeuroEng Rehabil 2011, 8: 1-21. 10.1186/1743-0003-8-1
This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (Grant No. 2011-0023999).
The authors declare that they have no competing interests.
The work was carried out as part of the Ph.D study by Mr. Yubo Wang under the guidance of Dr. Kalyana Veluvolu and Dr. Minho Lee. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.