Continuous decoding of movement intention of upper limb self-initiated analytic movements from pre-movement EEG correlates
Journal of NeuroEngineering and Rehabilitation volume 11, Article number: 153 (2014)
Brain-machine interfaces (BMI) have recently been integrated within motor rehabilitation therapies by actively involving the central nervous system (CNS) within the exercises. For instance, the online decoding of intention of motion of a limb from pre-movement EEG correlates is being used to convert passive rehabilitation strategies into active ones mediated by robotics. As early stages of upper limb motor rehabilitation usually focus on analytic single-joint mobilizations, this paper investigates the feasibility of building BMI decoders for these specific types of movements.
Two different experiments were performed within this study. For the first one, six healthy subjects performed seven self-initiated upper-limb analytic movements, involving from proximal to distal articulations. For the second experiment, three spinal cord injury patients performed two of the previously studied movements with their healthy elbow and paralyzed wrist. In both cases EEG neural correlates such as the event-related desynchronization (ERD) and movement related cortical potentials (MRCP) were analyzed, as well as the accuracies of continuous decoders built using the pre-movement features of these correlates (i.e., the intention of motion was decoded before movement onset).
The studied movements could be decoded in both healthy subjects and patients. For healthy subjects there were significant differences in the EEG correlates and decoding accuracies, dependent on the moving joint. Percentages of correctly anticipated trials ranged from 75% to 40% (with chance level being around 20%), with better performances for proximal than for distal movements. For the movements studied for the SCI patients the accuracies were similar to the ones of the healthy subjects.
This paper shows how it is possible to build continuous decoders to detect movement intention from EEG correlates for seven different upper-limb analytic movements. Furthermore we report differences in accuracies among movements, which might have an impact on the design of the rehabilitation technologies that will integrate this new type of information. The applicability of the decoders was shown in a clinical population, with similar performances between healthy subjects and patients.
Motor rehabilitation with robotic or functional electrical stimulation exercises has emerged as a promising alternative to design new therapies for stroke or spinal cord injury (SCI) patients [1–3]. An emerging trend in these new therapies is to shift from passive mobilizations to exercises that involve the central nervous system (CNS) in an active way , as it has been shown that this type of rehabilitation enhances neuroplasticity [5, 6]. Movement intention is a key state that expresses the CNS active involvement with well-established EEG correlates (e.g., the event-related desynchronization/synchronization, ERD/S , or the motor-related cortical potentials, MRCP ). These correlates have the advantage of anticipating any peripheral measurement, which make them suitable to build more usable and natural BMIs [9, 10], and allow high temporal precision for the control of prosthetic or orthotic devices . In addition, they are measurable even in paralyzed patients [12–15]. During early stages of rehabilitation (e.g., in acute and subacute phases after a stroke or SCI), physiotherapy exercises include analytic movements (i.e., mobilization of single joints), as they help to improve joint range of motion and muscular activity, enhance oxygen metabolism, and can be performed before the patients are ready to execute more complex movements [16, 17]. To evaluate the applicability of technologies that use the movement intention in the early stages of rehabilitation, there is a need to understand how this intention can be decoded under a wide range of analytic movements. As a first step, this paper analyzes the possibility of building decoders for seven upper-limb analytic movements using pre-movement EEG correlates with healthy subjects. In addition, the proposed decoders are tested in a clinical environment with a small cohort of SCI patients.
EEG continuous decoding of motor intention has been achieved using either ERD/S or MRCP correlates for functional movements such as reaching tasks [12, 14]; for multiple joint movements such as simultaneous movement of both feet  or hand movement imagination [13, 19]; and for single joint analytic movements such as wrist extension [10, 20, 21] or ankle dorsiflexion [22, 23]. Statistical differences in ERD/S and MRCP correlates have been demonstrated not only between rest and motion (or motor imagery) but also between different types of movements [8, 24–26], which is why they have been used to distinguish between different motor tasks [9, 27–29]. Since they reflect different neurophysiological phenomena , their combination has been proven to outperform single trial classification of movements [31, 32], and decoding of motion intention .
This paper shows the applicability of BMIs in upper-limb self-initiated analytic movements with two different experiments. The first experiment studies the seven degrees of freedom of the arm. This experiment was performed on healthy subjects so that they could perform all the movements correctly. The second experiment evaluates, on a target population (SCI patients), the applicability of the BMI with two of the previous movements: one that they could perform normally, and a second one that they could not execute completely. ERD and MRCPs of the different movements were studied in both healthy and SCI patients. The decoders of movement intention (pre-movement state) combined ERD and MRCP features using a sparse feature selection method. The results shed light on: (i) the differences of the neural correlates on an ample set of upper-limb movements, (ii) the applicability of BMI technology to the different arm movements on healthy subjects as well as SCI patients, and (iii) on practical issues such as the automation of the feature selection process and decoding time-anticipation (which is important for incorporating feedback strategies that trigger neuroplasticity mechanisms ).
Two different experiments were designed for this study. The first one shows the differences in BMI applicability for the seven degrees of freedom of the arm on healthy subjects. The second experiment validates the use of the proposed BMI on a clinical population of SCI patients. All participants (healthy subjects and patients) were duly informed before the experiment and all of them provided written informed consent. The experimental procedure was approved by the Ethics Review Board of the Hospital Nacional de Parapléjicos (Toledo, Spain).
Six healthy right-handed male subjects (mean age 26.66±2.94 years) participated in this experiment. Participants were comfortably seated 1.5 m away from a computer screen, which displayed the instructions during the experiment. The chair incorporated a removable armrest that was only used for movements that required it. Additionally, a supplementary table was used to hold the arm in an elevated rest position for movements that required that support. Seven analytic movements of the right upper limb were studied (Figure 1). They were selected to evaluate the seven degrees of freedom of the three arm joints separately. As each movement had a different initial position, the participants started each block with the arm in the position required for the upcoming task:
SA: Shoulder abduction-adduction (Figure 1A). Initial position: arm hanging straight down.
● Task: 90° abduction (separation) and adduction (approximation) to initial position.
SF: Shoulder flexion-extension (Figure 1B).
● Initial position: arm hanging straight down.
● Task: 90° flexion (forward) and extension (backwards) to initial position.
SR: Shoulder external-internal rotation (Figure 1C).
● Initial position: elbow resting on a table situated next to subject.
● Task: 90° external rotation (upwards) and return to initial position.
EF: Elbow flexion-extension (Figure 1D).
● Initial position: arm resting over subject’s leg, palm upwards.
● Task: maximal elbow flexion and extension to initial position.
EF: Elbow supination-pronation (Figure 1E).
● Initial position: elbow resting over the chair armrest, hand open and parallel to the wall.
● Task: 90° supination (palm upwards) followed by 90° pronation (palm downwards) and return to initial position.
WE: Wrist extension-flexion (Figure 1F).
● Initial position: elbow lying over the chair armrest, hand open and parallel to the floor, palm downwards.
● Task: maximal wrist extension (upwards) and flexion to initial position.
WR: Wrist radial-ulnar deviation (Figure 1G).
● nitial position: elbow lying over the chair armrest, hand open and parallel to the floor, palm downwards.
● Task: radial deviation (inner movement) followed ulnar deviation (outer movement) and return to initial position.
Experimental sessions consisted of 14 blocks of trials (2 blocks per movement) in the following order: SA-SF-SR-EF-ES-WE-WR-SA-SF-SR-EF-ES-WE-WR. After each block, participants could rest as much time as they required. Each block included 25 trials of one movement type (totaling 50 recorded trials per movement). Trials lasted 13 seconds (block duration = 5´25˘); the screen showed the word Movement during the first 10 seconds and the word Rest during the last 3 seconds. Subjects were instructed to perform the analytic movement whenever they wanted during the Movement cue (self-initiated action), waiting at least 3 seconds after the cue appeared. They were explicitly asked to avoid mentally counting before starting movement. The Rest screen indicated to the subjects that they could blink and relax.
Three male incomplete quadriplegic patients were recruited for this experiment. All of them were in a subacute phase and hospitalized at the Hospital Nacional de Parapléjicos, in Toledo (Spain), where the experimentation sessions took place. As inclusion criteria, patients’ right arm should have the elbow flexors intact (score 5 out of 5 in a muscle strength scale ), and should have weakness in the wrist extensors (muscle strength 2-3 out of 5). Relevant information of each patient can be found on Table 1. This typology of lesion was chosen as it allowed to study EEG correlates and decoding performances of an arm movement that the patients can perform normally and a movement that they cannot execute despite them still having some muscle strength. In addition, these patients are more autonomous than the ones with higher and complete lesions (who frequently have breathing difficulties) and thus are better able to participate in a BMI intervention setup.
During the experiment, patients were seated in their wheelchair 1.5 meters away from a computer screen, which displayed the instructions. They were asked to perform two different analytic movements: EF (complete movement as healthy participants) and WE (to the maximum extension they were able to perform). Patients executed 6 blocks of 20 trials each (3 blocks per movement), totaling 60 trials of each movement. Blocks of both types of movements were intercalated, and patients could rest as long as they required after each block. The structure of these trials was the same as in Experiment 1. Patients were also instructed to perform self initiated movements and to avoid mentally counting.
EEG, EMG, and inertial measurement unit (IMU) signals were acquired in Experiment 1, while only EEG and EMG were recorded for Experiment 2 (as it was not expected to have a complete movement in one of the tasks). EEG and EMG signals were recorded together using a commercial g.Tec system (g.Tec GmbH, Graz, Austria). EEG configuration consisted of 32 active electrodes placed at AFz, F3, F1, Fz, F2, F4, FC5, FC3, FC1, FCz, FC2, FC4, FC6, C5, C3, C1, Cz, C2, C4, C6, CP5, CP3, CP1, CPz, CP2, CP4, CP6, P3, P1, Pz and P4 (according to the international 10/10 system). The ground and reference electrodes were placed on FPz and on the left earlobe, respectively. EMG setup consisted of 8 bipolar electrodes, placed at the right arm on top of the following muscles: (i) extensor digitorum, (ii) extensor carpi ulnaris, (iii) palmaris longus, (iv) external head of the biceps brachii, (v) lateral head of the triceps brachii, (vi) frontal side of the deltoid, (vii) lateral side of the deltoid, and (vii) posterior side of the deltoid over the teres minor and infraspinatus muscles. EEG and EMG signals were digitized at a sampling frequency of 512 Hz and power-line notch-filtered to remove the 50Hz line interference. An IMU acquisition system (Technaid S.L., Madrid, Spain) recorded accelerometer, gyroscope and magnetometer signals at a sampling frequency of 50 Hz. Sensors were placed over the three arm segments (hand, forearm, and arm), and over the trunk (sternum). After Experiment 1, the EEG, EMG and IMU signals were synchronized by using an artificial external pulse that was generated by a computer and sent to both recording systems.
For Experiment 1, IMU signals were resampled to 512 Hz using interpolation to match the EEG and EMG signals, and the three measurements were aligned using the artificial pulse. Information from the EMG and IMU sensors was evaluated to identify the onset of movements. However, since EMG signals were corrupted for certain subjects, IMU channels with the highest amplitudes and best consistency with the EMG activations were manually selected for each movement and subject in order to obtain the movement onsets. The movement onset detection procedure was as follows: (i) the mean of the selected IMU channels was removed, and the signals were rectified; (i i) when more than one IMU channel were selected, their values were averaged; (i i i) the movement onsets were defined as the time instants in which the signal was at 5% of the maximum amplitude. For Experiment 2, EMG signals of the biceps muscle and of extensor digitorum muscle were selected to detect movement onset of EF and WE, respectively, following the procedure used in .
EEG signals were trimmed down to 6-second trials (-3 to 3 seconds from the movement onset). Trials with movements that started before the 3-second waiting period were discarded. For Experiment 1, EEG channels FC3 and FC1 were removed from all the subjects, as they presented artifacts for all movements. Additionally, a z-score artifact rejection (similar to the one proposed in ) was performed on the following computed measurements: the power in δ (1-4 Hz), θ (4-7 Hz), α (7-12 Hz), and β (12-30 Hz) frequency bands, the trial variance and the maximum amplitude, discarding trials that contained values higher than 2.5 times the mean.
Optimal spatial filtering
Spatial filters such as CAR, Laplacian, common spatial patterns (CSP) and methods based on optimization techniques are broadly used to obtain reference-free signals and to enhance the signal to noise ratio (SNR) [22, 36, 37]. This paper evaluates the use of optimal spatial filters (OSF) to improve the SNR in ERD and MRCP signals. The OSF are computed for both signals (ERD and MRCP) as a linear combination of all EEG channels . First, EEG trials were bandpass filtered to [0.1-1] Hz for MRCPs, and [7-30] Hz for ERD. Next, the trials were segmented in the time intervals [-1, 1] s to represent the signal of interest (denoted by S EEG ) and [-3, -1] s for the noise (N EEG ). Note that 0 is the time of the movement onset.
Given a set of L epochs of S EEG and L epochs of N EEG , the SNR was computed as:
where P Si and P Ni represent the power of the signal of interest () and noise () for the ith trial, respectively. The vector of coefficients w=(w1,…,w c ) contained the weights for each channel, and it included 30 values for signals of Experiment 1 (since 2 channels were removed, see Signal preprocessing section) and 32 for Experiment 2.
This procedure was performed separately for MRCP and ERD (i.e., the application of the OSFs generated two new signals, denoted hereafter as OSF signals: one to optimize ERD and the other to optimize MRCP). For MRCP the SNR was maximized, as there is a need to have high amplitude in the interval of interest, and low amplitude in the noise period . In contrast, for ERD the SNR was minimized, as there is a decrease in power during movement with respect to the non-movement or noise interval . A constrained optimization solver was used (Matlab function fmincon), setting the sum of w to be equal to zero. The vector w was initialized as a CAR filter for channel Cz when computing the OSF of MRCP, and as a CAR filter for channel C3 in the case of ERD.
ERD and MRCP were analyzed for each movement on the EEG channels and the optimized OSF signals. The event-related desynchronization analysis was used to measure the power modulations in α and β frequency bands. The EEG trials were filtered using small Laplacian derivations to reduce the effects of volume conduction . Next, the filtered channels and the OSF signal were bandpass filtered between 1 and 50 Hz using a zero-phase fourth-order Butterworth filter. The time-frequency representation of each subject and movement was computed using Morlet Wavelets in the frequency range [1-50] Hz . Statistical significance (α=0.05) of the time-frequency analysis was computed with respect to baseline [-3, -1] using a bootstrap resampling method . To compute the motor-related cortical potentials, EEG trials were filtered with a common average reference (CAR). Filtered trials and OSF signal were subsampled to 64 Hz, and bandpass filtered to the frequency range [0.1-1] Hz . A zero-phase second-order Butterworth filter was used, as it worked just as well as the finite impulse response filter suggested in , and in a lower order.
Movements were grouped according to their joint (i.e., shoulder, elbow and wrist) by averaging the values of the movements corresponding to each of them. ERD and MRCP differences between joints were studied using one-way repeated measures analysis of variance (ANOVA) with the within-subjects factor moving joint. Post-hoc comparisons were done using paired t-tests with Bonferroni correction.
Feature extraction and classification
For each time instant t the following features were computed using a one-second time window [t−1,t]:
ERD: A Laplacian filter was applied to the EEG channels and the power spectra was computed using a 16t h order autoregressive model with a frequency resolution of 1 Hz . Power values in all frequency bins that included α and β bands were selected (7-30 Hz). The 19 channels comprising fronto-central (FCx), central (Cx), and centro-parietal (CPx) areas were chosen. In total, 456 features were generated. Additionally, the same steps were applied to compute the power spectra of the OSF signal, which produced 24 features.
MRCPs: The EEG trials were CAR filtered, subsampled to 64 Hz and filtered in the range [0.1-1] Hz. Time samples in channels FCz, FC2, C1, Cz, C2, CP1, CPz, CP2 were selected. In total 512 features were computed. For the OSF signal the application of the same steps generated 64 extra features.
Therefore, the feature vectors of each time window were composed of 1056 values. Dimension reduction of feature vectors is usually performed automatically with separability metrics like Bhattacharyya or Mahalanobis distances [10, 28]. However, these methods can sometimes provide highly correlated features in EEG measurements. Therefore, in this paper we used an automatic selection procedure based on sparsity to select the most discriminant values from a large set of features, while removing redundant information . Sparse discriminant analysis (SDA) performs linear discriminant analysis (LDA) with a sparseness criterion imposed such that the feature selection and classification are performed simultaneously . This allows the estimation of covariance matrices in datasets with the number of features being large relative to the number of observations, as it was in our case. Feature vectors corresponding to the training set were processed with this algorithm, which was programed to select, from each vector, a number of features always inferior to the number of trials available for training. When computing the OSF for both ERD and MRCP features, coefficients were estimated using only the training set, and these coefficients were then applied to the test set.The classifier was trained to distinguish between the rest state and the pre-movement state from the brain signals. The examples of the rest class were the one-second-long time windows in the time interval [-3, -1] s computed with a sliding step of 0.25 s, and the movement intention was the window [-1, 0] s (Figure 2A). Note that no information of the actual movement was considered for training, as the objective of the BMI was to detect the movement before it occurred. Feature vectors were obtained from each time window in the training dataset, and their values were normalized to have zero mean and unit variance before training the classifier. Trials of the test set were evaluated with a sliding window applied to the time interval [-3, 0], with a sliding step of 0.125 s (Figure 2B).
Classifier evaluation and metrics
Classification of the trials from each subject and movement was evaluated separately. Given the reduced number of trials for each condition (after artifacting N≤50 for Experiment 1 and N≤60 for Experiment 2), the classification performance was evaluated using a trial-based leave-one-out cross-validation. For each fold, the classifier was trained using N−1 trials, and the test trial was evaluated with a sliding window.
Three different metrics were used to evaluate the classifier performance, which were computed on a trial basis, instead of using a sample-by-sample analysis that evaluates each test window independently. Firstly, ROC curves were used to evaluate the sensitivity and specificity , and the area under the curve (AUC) was used as performance metric, since it is threshold independent and also invariant to a priori probabilities . Furthermore, it has been proposed to use an event-by-event analysis to better model the behavior of a continuous decoder with ROC curves . Sensitivity and specificity were definied considering rest and movement intention periods as events. Thus, true positive events (TPE) were defined as correct onset detections made in the time interval [-1, 0]; false positive events (FPE) as events with at least one classifier onset misclassification during the rest phase [-3, -1]; true negative events (TNE) as rest periods with no false onset detections; and false negative events (FNE) as movement intention periods with no correct onset detections. Secondly, the percentage of correct trials was measured. This metric captures the number of executions that would provide a correct detection (i.e., a correct trigger for the robot or electrical stimulator during a therapy) before any other peripheral measurement . A trial was correct if no intention of movement was detected before t=−1 s, and if an intention was detected between t=−1 s and t=0 s with respect to the actual onset (i.e., its rest period was a TNE, and its movement intention was a TPE). Thirdly, for all correct trials, their anticipation was calculated as the period between the detection time and the movement onset. Given the definition of correct trials, only activations in the period [-1, 0] s were taken into account.
Significant ERD activity (p<0.05) in α (7-12 Hz) and β (12-30 Hz) frequency bands was found more prominently over the contralateral motor cortex before and during the movement for almost all movements and subjects. Figure 3 displays the ERD averaged for all subjects over the motor cortex for each movement. Additionally, Table 2 synthesizes the pre-movement (time interval [-1, 0] s) ERD values of channel C3 for each subject and movement, and the averages for movements and subjects. Notice that averaged pre-movement ERD was higher for proximal than for distal movements. ANOVA showed statistical significance over the pre-movement α ERD (F2,10=5.7,p<0.05) but not on the β ERD. Post-hoc pair-wise tests with Bonferroni correction revealed differences between the shoulder and the wrist (p=0.008).
Averaged MRCPs for all subjects and for each type of movement are displayed in Figure 3. The values of all the MRCPs were normalized to the peak value of the movement with highest amplitude for each subject. The lateralized cortical potential towards contralateral motor area was present for all movements and subjects. Table 3 summarizes the normalized amplitudes of the MRCP negative peaks of channels Cz and C1. There were no statistical differences between joints in peak amplitude for channels Cz (p>0.05) and C1 (p>0.05).
The ERD in the OSF signal (right area of each panel in Figure 3) was significantly higher than in C3 for α band (Wilcoxon matched pairs signed-rank test, p < 10−7) and β band (p < 10−7). Averaged ERD for all subjects and movements in channel C3 was −29.5% in α band and −17.0% in β band (bottom-right values in Table 2), while in the OSF signal were −54.9% and −36.6%, respectively. The amplitude of MRCPs was also significantly higher in the OSF signal than in Cz (p < 0.001) and C1 (p < 0.01). While the average normalized amplitude was −0.47 in Cz and −0.52 in C1 (Table 3), the OSF signal had an average amplitude of −2.94 in the same normalized scale.
Average ROC curves for each movement are shown in Figure 4. Circles on each line represent the working points where sensitivity equals specificity, which give the optimal thresholds . Proximal movements presented higher AUC than distal ones, in agreement with the electrophysiology analysis, which showed higher average values of ERD and MRCP peaks. With the optimal threshold in the ROC curve, the movement with highest AUC (SF) had 85.6% of true positives and 15.1% of false positives. On the other hand, for the movement with poorest AUC (WR), the decoder provided 64.8% of true positives and 36.2% of false positives. Pre-movement α and β ERD showed significant correlation with AUC (r α =−0.49, p α <10−3; r β =−0.66, p β <10−5). Regarding MRCP peak amplitude, it also showed a significant correlation for channels C1 (rC1=−0.57, pC1<10−4), and Cz (r Cz =−0.36, p Cz <0.02). ANOVA showed a significant effect of moving joint in AUC (F2,10=8.0,p<0.01). However, post-hoc comparisons after Bonferroni correction did not show significant differences, although differences between shoulder and wrist were close to the significance level (p=0.064).
Table 4 shows the percentage of correct trials for each movement averaged for all subjects. Movements with higher AUC provided better rates of accepted trials. In all cases, the number of correct trials was higher than the empirical chance level (obtained with the same leave-one-out procedure, but randomizing the labels before training the classifier), which provided on average 21.2±3.4% of correct trials. There was a significant effect on the moving joint in percentage of correct trials as revealed by ANOVA (F2,10=10.6,p<0.01), with significant differences between shoulder and wrist (p=0.04).
Average onset detection times ranged from -421 ms in the best case (WR) to -256 ms for the least anticipated movement (EF), with respect to the movement onset (Figure 5). The moving joint had a significant effect in anticipation, shown by ANOVA (F2,10=8.6,p<0.01), and post-hoc comparisons revealed statistical differences between elbow and wrist movements (p=0.048).
Analysis of features
As features were selected automatically by the SDA, an analysis was performed to understand the information used by the algorithm. Figure 6 shows a projection of the features selected for each fold of the leave-one-out procedure to the channels-frequencies space (for ERD), and to the channels-time space (for MRCP), averaged for all subjects and movements. For ERD, bins in the frequencies 7 Hz (lower α), [10-15] Hz (upper α) and [22-25] Hz (β) were more often selected in the OSF channel, but also in channels placed over ipsi and contralateral motor cortices (e.g., C3, C1, C4). Regarding time features of MRCP, note how the most frequently selected were the last samples of the time-window (samples in the figure above t=1 s), which coincide with the maximum peak of the MRCP.
The OSF signal was the most frequently selected in both cases. Thus the mean weight given to each channel for the OSF computed for each subject and movement was obtained. Figure 7 shows the weights obtained for ERD (Figure 7A) and MRCP (Figure 7B) filters, averaged for all subjects and movements. The figures show that the left motor cortex (contralateral to the movement) and the central area of the motor cortex were the areas with the highest weights to build the OSF for ERD and MRCP, respectively. These are the areas that would probably be selected if a manual feature selection was performed, based on previous electrophysiology studies which show how ERD is originated contralaterally to the movement , while MRCP is generated closer to the midline vertex .
Significant α and β ERD, and MRCPs were found for the three patients for both movements. Figure 8 shows both EEG correlates averaged for the three patients. ERD magnitudes and MRCP amplitudes were similar between the healthy subjects and patients. Furthermore, they were also similar between the executed and the attempted movements by the patients group, suggesting that these EEG correlates can also be used for decoding of movement intention of paralyzed joints in this population of patients.
Average ROC curves for movement execution of EF and attempt of WE are shown in Figures 9A-B. The resulting AUC were very similar for both tasks (0.81 for EF and 0.84 for WE), and also similar to the ones obtained for the group of healthy subjects for the same movements (0.86 for EF and 0.77 for WE). For the execution of EF, 71.1% of true positives and 31.0% of false positives would be obtained with the optimal threshold. For the attempt of WF, the decoder provided 77.5% of true positives and 24.7% of false positives.
Table 5 shows the percentage of correct trials obtained for the SCI patients. For the execution of EF, 50.2% of trials were decoded before the movement onset, while for the attempt of WE the percentage of anticipated trials was 57.7%.The anticipation for both tasks was similar, as can be observed in Figure 9C. Average onset detection times were -352 ms for EF and -364 ms for WE.
The electrophysiology analysis showed that both healthy subjects and the studied SCI patients presented ERD and MRCP activations for the different movements. For the healthy subjects, there were statistical differences dependent on the moving joint for pre-movement α ERD. This result complements work by Pfurtscheller et al. , which showed statistical differences in post-movement β ERS for distal movements (wrist, finger and thumb). In addition to this, we found no statistical differences between movements in MRCP amplitude. These results agree with previous analysis reported in , which compared MRCPs for shoulder, elbow and finger movements and only found statistical differences between shoulder and finger. However, as we did not record finger motions, further investigation would be required to study whether there exist variations between MRCP amplitudes in the movements covered in this paper and finger movements.
Decoding results reported for the first experiment show the applicability of BMI on healthy subjects for the three different joints of the arm, with accuracies ranging from 40% to 75%, dependent on the type of movement. Although studies have shown that the target population of BMI rehabilitation (i.e., paralyzed patients) may have altered brain patterns during motor tasks [15, 46–48], several works have successfully used classifiers based on ERD or in MRCPs to decode motion intention in these paralyzed patients [5, 6, 12–14, 22]. Indeed, results of the second experiment showed similar BMI performances between the healthy group (EF: 60.8%, WR: 39.5%) and the studied SCI patients (EF: 50.2%, WR: 57.7%). Despite the fact that performances were higher for elbow than for wrist movements for healthy subjects, this was not the case for SCI patients (which executed elbow movements and attempted wrist movements). On the contrary, accuracy was slightly higher for wrist than for elbow movements for the patients, and also than for wrist movements performed by healthy subjects. As the number of patients in this experiment was limited, further research should be done to verify if significant differences in accuracies between motor execution and motor attempt are present in these patients. This might be explained by the recruitment of additional brain regions during movement attempt when compared to movement execution .
Decoding accuracies were dependent on the movement as revealed by the statistical tests. Percentages of correctly anticipated trials ranged from almost 40% in the worst movements (wrist) to near 75% in the best ones (shoulder). These performances were correlated with both MRCP amplitude and ERD, despite the fact that MRCP amplitudes did not show any statistical difference between movements. A detailed comparison of these results with previous works on continuous decoding of motor intention [10, 12–14, 18–23, 33] is difficult to provide due to differences in the protocols and reported metrics. For instance, in  the anticipation window utilized for wrist extension decoding in healthy subjects was larger than the one used in this paper, and the percentage of correct trials they achieved was around 30%. In  they also considered detections after the movement onset for ankle dorsiflexion, and reported accuracies of about 80% with healthy subjects and 55% with stroke patients. A recent study with a similar methodology to that presented in this paper decoded around 65% of reaching movement trials with healthy and stroke subjects, when considering as valid the onsets detected between -0.75 and 0.75 seconds . The accuracies reported in this paper correspond to trials decoded between -1 second and the movement onset. When also considering the trials decoded up to one second after the movement onset as valid, the average accuracy was increased more than 10% (details not reported in this paper).
All the decoding process has been automated, as it has been pointed as an important property for the deployment of BMIs in rehabilitation . For each subject and movement, the proposed decoder was able to select among a large number of features extracted from MRCPs and ERD in a completely automated manner. The combination of both types of features improved significantly the use of each feature alone in terms of correct trials and anticipation, as has also been shown in a parallel work with healthy and stroke subjects . However, as the results presented in this paper were obtained offline with cross-validation, and zero-phase filters were used, a drop in performance might be expected when operating online. Previous works have reported a drop of about 10% in true positive rate when changing from offline to online operation in movement decoding using MRCPs [22, 23]. Therefore, further research would be necessary to evaluate the impact of this drop when combining both types of features (ERD and MRCPs) with our optimized feature selection procedure. Interestingly, the automatically selected features were consistent with the electrophysiology analysis and, therefore, could be used as a plausible methodology to induce brain plasticity in neurorehabilitation, or to use natural brain commands for motor substitution.
The EEG decoding results presented in this paper (with anticipated trials ranging from 40% to 75%) show that the movement chosen for the rehabilitation exercises has a significant impact on the BMI accuracy. These accuracy differences are important in a rehabilitation context as they may have an impact on the applicability of BMI decoders for therapies involving analytic movements. However, it is still unclear how different decoding accuracies can affect the rehabilitation outcome, both in terms of functional recovery or neural reorganization. An interesting pursuit for future research would be to evaluate the relationship between decoding accuracy and rehabilitation outcome, since recent studies that successfully applied online BMI to provide feedback to the subjects did not report performances achieved, but pointed on the importance of the temporal decoding precision [5, 11].
This work showed the applicability of a BMI on seven upper limb analytic movements (i.e., the seven degrees of freedom of the arm). An experiment with healthy subjects revealed that the seven movements can be decoded before the actual movement onsets, and that there are differences in EEG correlates and decoding performances dependent on the moving joint. A second experiment performed with SCI patients showed how this BMI can be applied in a clinical population. Similar performances were achieved for movements they could and could not perform. Performances were also similar between the patients and the healthy subjects.
Written informed consent was obtained from all the healthy subjects and patients for the publication of this report and any accompanying images.
Granat MH, Ferguson AC, Andrews BJ, Delargy M: The role of functional electrical stimulation in the rehabilitation of patients with incomplete spinal cord injury–observed benefits during gait studies. Paraplegia. 1993, 31 (4): 207-215. 10.1038/sc.1993.39.
Kwakkel G, Kollen BJ, Krebs HI: Effects of robot-assisted therapy on upper limb recovery after stroke: a systematic review. Neurorehabil Neural Repair. 2008, 22 (2): 111-121.
Asín G, Cano-de-la-Cuerda R, López-Larraz E, Metrot J, Molinari M, van Dokkum LE: Emerging perspectives in stroke rehabilitation. Emerging Therapies in Neurorehabilitation. Edited by: Pons JL, Torricelli D. 2014, Berlin Heidelberg: Springer, 3-21.
Daly JJ, Wolpaw JR: Brain–computer interfaces in neurological rehabilitation. Lancet Neurology. 2008, 7 (11): 1032-1043. 10.1016/S1474-4422(08)70223-0.
Ramos-Murguialday A, Broetz D, Rea M, Läer L, Yilmaz O, Brasil FL, Liberati G, Curado MR, Garcia-Cossio E, Vyziotis A, Cho W, Agostini M, Soares E, Soekadar S, Caria A, Cohen LG, Birbaumer N: Brain-machine interface in chronic stroke rehabilitation: a controlled study. Ann Neurol. 2013, 74 (1): 100-108. 10.1002/ana.23879.
Buch E, Weber C, Cohen LG, Braun C, Dimyan MA, Ard T, Mellinger J, Caria A, Soekadar S, Fourkas A, Birbaumer N: Think to move: a neuromagnetic brain-computer interface (BCI) system for chronic stroke. Stroke. 2008, 39 (3): 910-917. 10.1161/STROKEAHA.107.505313.
Pfurtscheller G, Lopes da Silva FH: Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin Neurophysiol. 1999, 110 (11): 1842-1857. 10.1016/S1388-2457(99)00141-8.
Shibasaki H, Hallett M: What is the Bereitschaftspotential?. Clin Neurophysiol. 2006, 117 (11): 2341-2356. 10.1016/j.clinph.2006.04.025.
Morash V, Bai O, Furlani S, Lin P, Hallett M: Classifying EEG signals preceding right hand, left hand, tongue, and right foot movements and motor imageries. Clin Neurophysiol. 2008, 119 (11): 2570-2578. 10.1016/j.clinph.2008.08.013.
Bai O, Rathi V, Lin P, Huang D, Battapady H, Fei DY, Schneider L, Houdayer E, Chen X, Hallett M: Prediction of human voluntary movement before it occurs. Clin Neurophysiol. 2011, 122 (2): 364-372. 10.1016/j.clinph.2010.07.010.
Mrachacz-Kersting N, Kristensen SR, Niazi IK, Farina D: Precise temporal association between cortical potentials evoked by motor imagination and afference induces cortical plasticity. J Physiol. 2012, 590 (7): 1669-1682.
Antelis JM, Montesano L, Ramos-Murguialday A, Birbaumer N, Minguez J: Continuous decoding of intention to move from contralesional hemisphere brain oscillations in severely affected chronic stroke patients. 34th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 2012, San Diego, USA: IEEE-EMBS, 4099-4103.
López-Larraz E, Antelis JM, Montesano L, Gil-Agudo A, Minguez J: Continuous decoding of Motor Attempt and Motor Imagery from EEG Activity in Spinal Cord Injury Patients. 34th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 2012, San Diego, USA: IEEE-EMBS, 1798-1801.
Lew E, Chavarriaga R, Silvoni S, Millán JdR: Detection of self-paced reaching movement intention from EEG signals. Frontiers Neuroeng. 2012, 5: 13-
Green JB, Sora E, Bialy Y, Ricamato A, Thatcher RW: Cortical motor reorganization after paraplegia: an EEG study. Neurology. 1999, 53 (4): 736-743. 10.1212/WNL.53.4.736.
Jigjid E, Kawashima N, Ogata H, Nakazawa K, Akai M, Eto F, Haga N: Effects of passive leg movement on the oxygenation level of lower limb muscle in chronic stroke patients. Neurorehabil Neural Repair. 2008, 22 (1): 40-49.
Smedes F, van der Salm A, Koel G, Oosterveld F: Manual mobilization of the wrist: a pilot study in rehabilitation of patients with a chronic hemiplegic hand post-stroke. J Hand Therapy. 2014, 27 (3): 209-216. 10.1016/j.jht.2013.12.011.
Solis-Escalante T, Müller-Putz G, Pfurtscheller G: Overt foot movement detection in one single laplacian eeg derivation. J Neurosci Methods. 2008, 175 (1): 148-153. 10.1016/j.jneumeth.2008.07.019.
Townsend G, Graimann B, Pfurtscheller G: Continuous EEG classification during motor imagery–simulation of an asynchronous BCI. IEEE Trans Neural Syst Rehabil Eng. 2004, 12 (2): 258-265. 10.1109/TNSRE.2004.827220.
Awwad Shiekh Hasan B, Gan JQ: Unsupervised movement onset detection from EEG recorded during self-paced real hand movement. Med Biol Eng Comput. 2010, 48 (3): 245-253. 10.1007/s11517-009-0550-0.
Ibañez J, Serrano JI, del Castillo MD, Barrios L, Gallego JA, Rocon E: An EEG-based design for the online detection of movement intention. Advances in Computational Intelligence. 2011, Berlin Heidelberg: Springer, 370-377.
Niazi IK, Jiang N, Tiberghien O, Nielsen JF, Dremstrup K, Farina D: Detection of movement intention from single-trial movement-related cortical potentials. J Neural Eng. 2011, 8 (6): 066009-10.1088/1741-2560/8/6/066009.
Xu R, Jiang N, Lin C, Mrachacz-Kersting N, Dremstrup K, Farina D: Enhanced low-latency detection of motor intention from EEG for closed-loop brain-computer interface applications. IEEE Trans Biomed Eng. 2014, 61 (2): 288-296.
Pfurtscheller G, Neuper C, Andrew C, Edlinger G: Foot and hand area mu rhythms. Int J Psychophysiol. 1997, 26 (1-3): 121-135. 10.1016/S0167-8760(97)00760-5.
Pfurtscheller G, Zalaudek K, Neuper C: Event-related beta synchronization after wrist, finger and thumb movement. Electroencephalogr Clin Neurophysiol. 1998, 109 (2): 154-160. 10.1016/S0924-980X(97)00070-2.
Jankelowitz SK, Colebatch JG: Movement-related potentials associated with self-paced, cued and imagined arm movements. Exp Brain Res. 2002, 147 (1): 98-107. 10.1007/s00221-002-1220-8.
Wang T, Deng J, He B: Classifying EEG-based motor imagery tasks by means of time-frequency synthesized spatial patterns. Clin Neurophysiol. 2004, 115 (12): 2744-2753. 10.1016/j.clinph.2004.06.022.
Pfurtscheller G, Brunner C, Schlögl a: Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks. NeuroImage. 2006, 31 (1): 153-159. 10.1016/j.neuroimage.2005.12.003.
Deng J, Yao J, Dewald JPA: Classification of the intention to generate a shoulder versus elbow torque by means of a time-frequency synthesized spatial patterns BCI algorithm. J Neural Eng. 2005, 2 (4): 131-138. 10.1088/1741-2560/2/4/009.
Babiloni C, Carducci F, Cincotti F, Rossini PM, Neuper C, Pfurtscheller G, Babiloni F: Human movement-related potentials vs desynchronization of EEG alpha rhythm: a high-resolution EEG study. NeuroImage. 1999, 10 (6): 658-665. 10.1006/nimg.1999.0504.
Dornhege G, Blankertz B, Curio G, Müller KR: Boosting bit rates in non-invasive EEG single trial classification by feature combination and multi class paradigm. IEEE Trans Biomed Eng. 2004, 51 (6): 1-10.
Velu PD, de Sa VR: Single-trial classification of gait and point movement preparation from human EEG. Frontiers Neurosci. 2013, 7: 84-
Ibáñez J, Serrano JI, Del Castillo MD, Monge-Pereira E, Molina-Rueda F, Alguacil-Diego I, Pons JL: Detection of the onset of upper-limb movements based on the combined analysis of changes in the sensorimotor rhythms and slow cortical potentials. J Neural Eng. 2014, 11 (5): 056009-10.1088/1741-2560/11/5/056009.
Kirshblum SC, Waring W, Biering-Sorensen F, Burns SP, Johansen M, Schmidt-Read M, Donovan W, Graves D, Jha A, Jones L, Mulcahey MJ, Krassioukov A: International standards for neurological classification of spinal cord injury (Revised 2011). J Spinal Cord Med. 2011, 34 (6): 547-554. 10.1179/107902611X13186000420242.
Maeder CL, Sannelli C, Haufe S, Blankertz B: Pre-stimulus sensorimotor rhythms influence brain-computer interface classification performance. IEEE Trans Neural Syst Rehabil Eng: Publication IEEE Eng Med Biol Soc. 2012, 20 (5): 653-662.
McFarland DJ, McCane LM, David SV, Wolpaw JR: Spatial filter selection for EEG-based communication. Electroencephalogr Clin Neurophysiol. 1997, 103 (3): 386-394. 10.1016/S0013-4694(97)00022-2.
Blankertz B, Tomioka R, Lemm S, Kawanabe M, Müller KR: Optimizing spatial filters for robust EEG single-trial analysis. Signal Process Mag IEEE. 2008, 25 (1): 41-56.
Graimann B, Pfurtscheller G: Quantification and visualization of event-related changes in oscillatory brain activity in the time frequency domain. Prog Brain Res. 2006, 159: 79-97.
Hjorth B: An on-line transformation of EEG scalp potentials into orthogonal source derivations. Electroencephalogr Clin Neurophysiol. 1975, 39 (5): 526-530. 10.1016/0013-4694(75)90056-5.
Tallon-Baudry C, Bertrand O, Delpuech C, Permier J: Oscillatory gamma-band (30-70 Hz) activity induced by a visual search task in humans. J Neurosci. 1997, 17 (2): 722-734.
Garipelli G, Chavarriaga R, Millán JdR: Single trial analysis of slow cortical potentials: a study on anticipation related potentials. J Neural Eng. 2013, 10 (3): 036014-10.1088/1741-2560/10/3/036014.
Bos R, de Waele S: Autoregressive spectral estimation by application of the Burg algorithm to irregularly sampled data. IEEE Trans Instrum Meas. 2002, 51 (6): 1289-1294. 10.1109/TIM.2002.808031.
Clemmensen L, Hastie T, Witten D, Ersbøll B: Sparse discriminant analysis. Technometrics. 2011, 53 (4): 406-413. 10.1198/TECH.2011.08118.
Fawcett T: An introduction to ROC analysis. Pattern Recognit Lett. 2006, 27 (8): 861-874. 10.1016/j.patrec.2005.10.010.
Bradley AP: The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognit. 1997, 30 (7): 1145-1159. 10.1016/S0031-3203(96)00142-2.
Müller-Putz GR, Zimmermann D, Graimann B, Nestinger K, Korisek G, Pfurtscheller G: Event-related beta EEG-changes during passive and attempted foot movements in paraplegic patients. Brain Res. 2007, 1137: 84-91.
Tangwiriyasakul C, Verhagen R, Rutten WLC, van Putten MJAM: Temporal evolution of event-related desynchronization in acute stroke: a pilot study. Clin Neurophysiol. 2014, 125 (6): 1112-1120. 10.1016/j.clinph.2013.10.047.
Stȩpień M: Event-related desynchronization of sensorimotor EEG rhythms in hemiparetic patients with acute stroke. Neurosci Lett. 2011, 488 (1): 17-21. 10.1016/j.neulet.2010.10.072.
Hotz-Boendermaker S, Funk M, Summers P, Brugger P, Hepp-Reymond MC, Curt A, Kollias SS: Preservation of motor programs in paraplegics as demonstrated by attempted and imagined foot movements. NeuroImage. 2008, 39 (1): 383-394. 10.1016/j.neuroimage.2007.07.065.
Soria-Frisch A: A critical review on the usage of ensembles for BCI. Towards Practical Brain-Computer Interfaces. 2013, Berlin Heidelberg: Springer, 41-65.
This work has been supported by Spanish projects HYPER-CSD2009-00067, DPI2011-25892, and DGA-FSE (grupo T04), and by projects FP7 CORBYS IP (GA 270219) and FP7 NETT ITN (GA 289146). The authors want to thank Jaime Ibáñez and Fernando Trincado for their collaboration during the experiments with healthy subjects and patients, respectively.
The authors declare that they have no competing interests.
EL participated in study design, data recording and analysis, results interpretation and drafted the manuscript. LM participated in study design, results interpretation and drafted the manuscript. AG participated in the selection of clinical population and protocol adaptation for patients, and in manuscript revision. JM participated in study design, results interpretation and manuscript revision. All authors read and approved the final manuscript.
About this article
Cite this article
López-Larraz, E., Montesano, L., Gil-Agudo, Á. et al. Continuous decoding of movement intention of upper limb self-initiated analytic movements from pre-movement EEG correlates. J NeuroEngineering Rehabil 11, 153 (2014). https://doi.org/10.1186/1743-0003-11-153