Skip to main content

Table 7 Feature fusion and synchronization. Details on the synchronization and use of the multimodal feature. ‘–’ indicates that the authors gave no information on the respective matter

From: A review of combined functional neuroimaging and motion capture for motor rehabilitation

Category

Online/offline

Method

Trigger

Feature fusion details

References

Movement event detection

Offline

–

–

Movement event of left heel strike for calculation of EEG time domain features

[42]

–

–

Movement event of toe-off for calculation of EEG frequency domain features

[55]

Hardware

Pushbutton trigger

Movement onset of arm movement for calculation of EEG time-frequency features

[53]

-

–

Grip force onset for calculation of EEG time domain features

[50]

Online

Hardware

Photodiode/screen

Movement onset of hand for the training of a regression model based on EEG time domain features

[51]

Movement event detection; decoder training

Offline

Other

Digital signal

Training of naive Bayes classifier for detection of movement onset based on EEG time and time-frequency domain feautres

[40]

–

–

Movement onset/offset of gait for training/evaluation of UKF decoding joint kinematics

[44]

Movement event detection; statistical relationship

Offline

Hardware

Trigger signal

Movement events of stepping behavior and leaning direction to model their relationship to EEG time-frequency domain feautres

[57]

Hardware

Trigger signal

Movement onset of arm for calculation EEG time and time-frequency features

Correlation of kinematic assessment scores and a kinematics and EEG time and time-frequency features

[41]

Decoder training

Offline

–

–-

Training/validation of a presonalized linear regression model prediciting motor perfomance index based on EEG frequency domain features

[49]

Online

Software

Customized program

Training/validation of EEG UKF decoder that predicts joint kinematics

[48]

Software

UDP

Control of robotic arm based on movement and movement initiation and tuning of kinematic parameters via EEG-based SVM classifier

[43]

–

–

Training/evaluation of LSDA classifier predicting ankle movement onset based on EEG time domain features

[47]

Statistical relationship

Offline

Other

Manual

Training/Validation of a regression model for kinematic parameters and EEG time-frequency domain features

[39]

–

–

Correlation between kinematics, muscle and brain activity

[52]

–

–

Correlation of submovements onset/offset and EEG time domain feature

[54]

–

–

Correlation between gait parameters and fNIRS time domain features

[56]

Attention

Online

–

–

Game interaction based on movement and feedback on attention level via EEG

[46]

–

–

Game interaction based on movement and feedback on attention level via EEG

[45]