- Open Access
Brain network involved in visual processing of movement stimuli used in upper limb robotic training: an fMRI study
Journal of NeuroEngineering and Rehabilitation volume 9, Article number: 49 (2012)
The potential of robot-mediated therapy and virtual reality in neurorehabilitation is becoming of increasing importance. However, there is limited information, using neuroimaging, on the neural networks involved in training with these technologies. This study was intended to detect the brain network involved in the visual processing of movement during robotic training. The main aim was to investigate the existence of a common cerebral network able to assimilate biological (human upper limb) and non-biological (abstract object) movements, hence testing the suitability of the visual non-biological feedback provided by the InMotion2 Robot.
A visual functional Magnetic Resonance Imaging (fMRI) task was administered to 22 healthy subjects. The task required observation and retrieval of motor gestures and of the visual feedback used in robotic training. Functional activations of both biological and non-biological movements were examined to identify areas activated in both conditions, along with differential activity in upper limb vs. abstract object trials. Control of response was also tested by administering trials with congruent and incongruent reaching movements.
The observation of upper limb and abstract object movements elicited similar patterns of activations according to a caudo-rostral pathway for the visual processing of movements (including specific areas of the occipital, temporal, parietal, and frontal lobes). Similarly, overlapping activations were found for the subsequent retrieval of the observed movement. Furthermore, activations of frontal cortical areas were associated with congruent trials more than with the incongruent ones.
This study identified the neural pathway associated with visual processing of movement stimuli used in upper limb robot-mediated training and investigated the brain’s ability to assimilate abstract object movements with human motor gestures. In both conditions, activations were elicited in cerebral areas involved in visual perception, sensory integration, recognition of movement, re-mapping on the somatosensory and motor cortex, storage in memory, and response control. Results from the congruent vs. incongruent trials revealed greater activity for the former condition than the latter in a network including cingulate cortex, right inferior and middle frontal gyrus that are involved in the go-signal and in decision control. Results on healthy subjects would suggest the appropriateness of an abstract visual feedback provided during motor training. The task contributes to highlight the potential of fMRI in improving the understanding of visual motor processes and may also be useful in detecting brain reorganisation during training.
New technologies such as robotics and virtual reality are increasingly being used alongside traditional rehabilitation treatments in order to assist, enhance and assess motor training. The role of these technologies within therapeutic treatment programs and their effectiveness are currently under debate [1–6]. In particular, their association with traditional therapy  and the differences between improvements in motor control and in activities of daily living are discussed in the literature . Recent evidence suggests that the contribution of new technologies to clinical practice is currently limited to providing intensive and repetitive movements and that the potential of robotic devices in neurorehabilitation has not been completely investigated . Furthermore, there is limited description of the neural networks involved and of the brain reorganisation related to training. In this regard, neuroimaging techniques represent a powerful tool. Simple and complex movement and motor imagery tasks were used to investigate motor processing in healthy and neurologically impaired subjects in experiments with functional Magnetic Resonance Imaging (fMRI) [10–12], Single Photon Emission Computerised Tomography , Positron Emission Tomography [14–16], Magnetoencephalography , and Direct Current potentials [18, 19]. Moreover, changes have been described in neuronal motor networks as a consequence of a rehabilitation training by means of functional and morphometric Magnetic Resonance techniques [20–23].
In studies with fMRI involving patients suffering from motor deficits, the selection of an appropriate task is a particularly relevant issue  and visual tasks may be preferred to motor ones in order to reduce involuntary head movements during scanning. With regard to this aspect, it has been shown that the neural network activated in humans following the observation of an action overlaps with that involved during the execution of the same action [25–27]. Furthermore, recent clinical trials have proved that action observation in chronic stroke patients improves functional abilities measured by clinical scales [28, 29] and induces cortical reorganisation as revealed by enlarged fMRI activation in the bilateral ventral premotor cortex, bilateral superior temporal gyrus, supplementary motor area (SMA) and contralateral supramarginal gyrus .
However, there is an open question regarding whether or not the processing of non-biological movements relies on the same structures as those involved in biological motion processing. In case of light-points portraying human biological motion significant fMRI activations were reported, compared with non-rigid random points motion, in the lingual and fusiform gyri, superior temporal sulcus (STS), kinetic occipital area (KO, lateral occipital cortex sensitive to kinetic contours), and lateral cerebellum . Servos et al. confirmed the role of the lingual gyrus during the recognition of light-points simulating human biological motion. The specific involvement in the perception of biological movements of the right posterior STS has also been highlighted by previous studies [32, 33]. Further data support the need of observing biological plausible movements to elicit a corresponding pre-motor cortex activation [34, 35]. On the contrary, other works reported that the observation of upper limb movements carried out by humanoid robotic devices may generate the same fMRI pattern activated by the observation of the human arm [36–38]. Saygin et al. reported no difference in the fMRI activation pattern during observation of body movements executed by humans or by robots. However, they found that the anterior part of the intraparietal sulcus (IPS) was significantly active in detecting the mismatch between appearance and motion, as in the case of androids with biological appearance performing mechanical movements.
In this study, we present a visual fMRI task able to indirectly estimate, by measuring brain haemodynamics [40, 41], the neuronal activation patterns related to the visual stimulation during upper limb robotic training. The task simulates the human and abstract object movements observed during a planar point-to-point reaching task with the InMotion2 Robot (Interactive Motion Technologies Inc., Boston, Massachusetts, USA), a device that exploits both visual and haptic feedback  (Figure 1). Human movements are presented as an arm performing a reaching gesture similar to that carried out during robotic training, whereas abstract object movements consist in a dot moving along straight trajectories that represent the visual feedback provided by the InMotion2 Robot. The experimental task was designed to identify the cerebral activity associated with visual processing (observation, analysis, and representation) of movements similar to those executed during robotic training. The main aim was to verify commonalities and differences in the brain networks able to process biological (human upper limb) and non-biological (abstract object) movements. A group of healthy subjects participated in this study. Comparing neuronal activity before and after rehabilitative training in impaired subjects is out of the scope of the present study. However, this analysis could be useful in testing the biological effectiveness of the visual feedback associated with robotic training. Furthermore, this study could contribute to the current debate about the use of action observation training in the treatment of stroke and cerebral palsy [43, 44].
The study was carried out on a sample of 22 healthy volunteers (8 males, age 25.6 ± 4.3 years, min = 19.2, max = 36.0). The inclusion criteria were: 18 to 39 years of age; right-handedness; no current or previous motor and neurological disorders; no current or previous rehabilitation protocols or robot-mediated training. A clinical evaluation was performed in each participant by a skilled physician prior to scanning. Informed consent was obtained from all subjects and the study was approved by the hospital’s Ethical Committee.
An fMRI visual task was set up. The task consisted in administering a video sequence of both human arm planar movements and straight trajectories of a dot, presented in a random order, along eight possible directions starting from the centre of the screen. The motion stimuli were followed by the image of the video screen presented during the rehabilitation training with the InMotion2 Robot, with a randomly positioned target point. The subjects were required to compare the direction of the observed motion stimulus (arm planar movement or dot trajectory) with the target position (Figure 2) and they were asked to mentally count the number of congruencies of the target position with any kind of motion stimulus. We hypothesised that, in each trial, the subject should process the observed stimulus (arm movement or dot trajectory), retrieve the arm movement or the dot trajectory, assess the congruence between direction of the stimulus and position of the target, and make a decision. According to this hypothesis, arm and dot trials only differ in the perceptual analysis of the anthropomorphic movement, which is absent in the case of the dot trajectory presentation. The use of a visual task allowed reducing involuntary head movements during the fMRI session. With the same aim, any kind of motor response from the subjects (e.g.: pushing a response button in a keypad) was avoided.
Both right and left arm movements from a healthy adult subject were video recorded during the execution of an InMotion2 training session (planar point-to-point reaching task) and adapted for the stimulation sequence. An acoustic signal was given to the subjects at the beginning of each trial (i.e., when an arm movement or a dot trajectory started). A time interval of random duration (750, 1,000, or 1,250 ms), during which subjects saw a blank screen, followed the motion stimulus and preceded the presentation of the target. A second variable time interval (1,000, 2,000, or 3,000 ms) was introduced following the target and before the onset of the successive motion stimulus (Figure 2). Four runs were performed by each subject. Each run consisted of 54 trials with randomised presentation of both biological and non-biological stimuli and all stimuli (right arm movements, left arm movements and dot trajectories) occurring with the same frequency at each run. Taking the 4 runs together, each movement direction was presented the same number of times and an equal number of congruent and incongruent trials occurred. To avoid possible ambiguities related to the interpretation of the human arm movements, the angular mismatch between the movement direction and the position of the target was greater than or equal to 90° both for arm movements and dot trajectories.
A 15’ practice session with the InMotion2 Robot was administered to each subject one hour before the fMRI exam. This very short session, aimed at familiarising with the task used in fMRI, was part of the instructions given to subjects prior to scanning and was followed by administering a set of trials of the fMRI task to verify their ability to perform it.
All scans were performed on the same MRI scanner (1.5 T Achieva, Philips Medical Systems, Best, the Netherlands) equipped with an 8-channels Sense head coil. The imaging protocol for each subject consisted of a 3D T1-weighted anatomical scan acquired as a structural reference and of 4 T2*-weighted Echo-Planar Imaging (EPI) sequences. The following parameters were used in EPI scans: repetition time (TR) = 2,500 ms, echo time (TE) = 46 ms, flip angle = 90°, field of view (FOV) = 256x140x256 mm, 28 axial slices (slice thickness = 5 mm, without gap), reconstruction matrix = 64x64 (pixel size = 4x4 mm), 6 dummy scans and 153 dynamic scans for each sequence (duration: 6’22”). The total scan time for the protocol was 31’45”. The stimuli sequences were implemented in the STIM2 software (Compumedics Neuroscan, El Paso, Texas, USA) and delivered by an MR-compatible stimulation system (NordicNeuroLab, Bergen, Norway).
FMRI data analysis
Analysis of fMRI data was performed with SPM8 (The Wellcome Department of Imaging Neuroscience, University College, London, UK) running in MATLAB (version 188.8.131.529, R2009b) (The Mathworks, Natick, Massachusetts, USA). For each subject, after motion correction, the anatomical MRI was coregistered to the mean functional image. Parameters for normalisation to the standard Montréal Neurological Institute (MNI) space were subsequently estimated and applied to the functional images. Finally, spatial smoothing was performed by convolving with an 8-mm full-width at half-maximum isotropic Gaussian kernel.
Statistical analysis was performed in a 2-stage mixed-effect procedure using the general linear model approach for event-related fMRI designs. In the 1st level, individual subject analysis, 6 regressors were used in each run to model the blood oxygenation level dependent (BOLD) response for each of 6 event types. The events were defined as observation of an arm movement (AM), observation of a dot trajectory (DT), presentation of a congruent target point following an AM (AMCT), presentation of a congruent target point following a DT (DTCT) and presentation of incongruent target points following AMs or DTs (AMIT and DTIT, respectively). Estimates of the 6 head movement parameters obtained from the realignment stage of pre-processing were included as additional regressors. Contrasts between regressors were then obtained for each subject.
The results from the 1st level analysis were entered into an one-sample t-test for the 2nd level analysis, thus enabling inferences based on the contrasts to be extended to the population from which the subjects were drawn . All statistical parametric maps (SPMs) were thresholded at p < 0.001 at the voxel-level (uncorrected) and only clusters surviving a family-wise error (FWE) corrected threshold of p < 0.05 were considered significant . A conjunction analysis of AM vs. implicit baseline (IB) and DT vs. IB contrasts was performed to identify areas activated in both conditions. The t-maps of these contrasts at the group level were thresholded, binarised, and multiplied voxel-wise with each other . The analysis of congruence between the observed arm movement or dot trajectory and the position of the target point implies retrieval from memory of the previously observed movement and imagery of the movement toward the target, which were referred to as “representation of arm movements” (AMT) and “representation of dot trajectories” (DTT). A second conjunction analysis was performed for these “representations”.
At the end of each fMRI run, subjects reported the number of congruent trials. Errors were less than 12 % for each run in each subject. This low percentage error was assumed to be a sufficient proof of subjects’ continued participation in the task. Therefore, no subject nor run was excluded from the group analysis due to low task performance.
Observation of arm movements and dot trajectories
When the observation of AMs was compared to the IB, a significant bilateral activation was found in the occipital lobe (primary, secondary and associative visual cortex, Brodmann Areas (BA) 17, 18, 19), parietal lobe (superior parietal lobules, BA 5, 7; supramarginal gyrus, BA 40; angular gyrus, BA 39; postcentral gyrus, BA 3, 1, 2; precuneus, BA 7 medial; paracentral lobule, BA 3, 1, 2, 5 medial), temporal lobe (middle and inferior temporal gyrus, fusiform gyrus, BA 20, 21, 22, 37), several areas of the frontal lobe (precentral gyrus-primary motor area, BA 4; SMA, BA 6; medial frontal gyrus, BA 8, 9; superior frontal gyrus, BA 4, 6, 8; middle frontal gyrus, BA 9; inferior frontal gyrus, BA 44, 46, 47), limbic lobe (cingulate gyrus, BA 31; hippocampus and parahippocampal gyrus, BA 27, 30), and insula (BA 13). Furthermore, activations were found in a large portion of the cerebellum (vermis, anterior and posterior cortex) and in the thalamus.
The comparison of DTs observation with the IB revealed a large pattern of activations overlapping with the above described network. Consequently, the conjunction analysis identified significant activations in all the regions mentioned above, with medial frontal gyrus activated only in the left hemisphere and a right lateralisation of the cingulate gyrus and parahippocampal gyrus (Figure 3).
The differential analysis between AM and DT conditions (AM > DT) showed significant differences in occipital lobe, temporal lobe and cerebellum (Table 1). Finally, the reverse contrast (DT > AM) highlighted only small clusters of voxels in the occipital and temporal regions.
Representation of arm movements and dot trajectories and congruence analysis
A network of activations was observed when the representation of arm movements (AMT) was compared to the IB. Regions with significant activations included the occipital lobe (primary, secondary and associative visual cortex, BA 17, 18, 19), the parietal lobe (superior parietal lobules, BA 5, 7; right supramarginal gyrus, BA 40; angular gyrus, BA 39; postcentral gyrus, BA 3, 1, 2; precuneus, BA 7 medial; paracentral lobule, BA 3, 1, 2, 5 medial), the temporal lobe (superior, middle and inferior temporal gyrus, fusiform gyrus, BA 20, 21, 22, 37, 38), the frontal lobe (left precentral gyrus-primary motor area, BA 4; right SMA, BA 6; medial frontal gyrus, BA 8, 9; superior frontal gyrus, BA 4, 6, 8; middle frontal gyrus, BA 9; inferior frontal gyrus, BA 46, 47), the limbic lobe (hippocampus, parahippocampal gyrus, BA 27, 30), insula, cerebellum, basal ganglia (caudate, left putamen) and the thalamus.
Similar to the case of movement observation, an overlapping pattern of activations was found when comparing the representation of dot trajectories (DTT) to the IB, so that all the above cited regions were present in the conjunction analysis of the two contrasts (Figure 4).
The presentation of the target following arm movements was compared with the presentation of the target following dot trajectories, showing significant differences in the superior parietal cortex and in the precuneus (AMT > DTT, Table 1). The reverse contrast (DTT > AMT) revealed a large cluster of voxels in the occipital lobe, temporal lobe and cerebellum, with a similar pattern to that obtained with the AM > DT contrast.
When comparing the presentation of congruent and incongruent targets (CT > IT), significant differences were found in the right occipital lobe (secondary and associative visual cortex, BA 18, 19), left parietal (postcentral gyrus, BA 3), right temporal (inferior temporal gyrus and fusiform gyrus, BA 37, 34), left frontal (orbital cortex, BA 47; precentral gyrus-primary motor area, BA 4; SMA, BA 6; olfactory cortex, BA 25), and right limbic lobe (parahippocampal gyrus and amygdala). Significant activations were also found in cerebellum, caudate, putamen and in the thalamus. AMs mainly contributed to this result, as evident from the analysis of component contrasts. In particular, the AMCT > AMIT contrast revealed significant differences in the right occipital lobe (associative visual cortex, BA 19), left parietal lobe (postcentral gyrus, BA 3), right temporal lobe (inferior temporal gyrus, BA 37), bilateral frontal lobe (SMA, BA 6; precentral gyrus-primary motor area, BA 4; middle and inferior frontal gyrus, BA 46, 10), and bilateral limbic lobe (cingulate cortex, BA 24, 31); on the contrary, no cluster survived a p < 0.10 FWE corrected threshold when the DTCT > DTIT contrast was applied. In the reverse contrast (IT > CT) no cluster survived the corrected threshold. However, when component contrasts were analysed, while no cluster survived a p < 0.10 FWE threshold in the AMIT > AMCT contrast, the DTIT > DTCT contrast revealed significant activations in the left occipital cortex (primary, secondary and associative visual cortex, BA 17, 18, 19).
In the present study, an fMRI experiment was used to investigate the brain regions involved in a visual task adapted from the training with the InMotion2 Robot. The task required upper limb motor gesture recognition and activation of the cognitive representations of arm movements and dot trajectories, both presented on a screen. The results showed a caudo-rostral neuronal pathway. Common activations between upper limb gestures and dot trajectories were found with regard to both movement observation and retrieval. Furthermore, the activation of areas involved in higher level cognitive functions was associated with the processing of congruent trials more than with the incongruent ones.
Observation of arm movements and dot trajectories
The pathway of activations found is consistent with previous studies [49–53] and points out that the neural correlates of movement are a property of the brain that emerges from a complex cortical-subcortical network. A significant bilateral activation was elicited during perception and recognition of arm movements, depicting a caudo-rostral pathway: visual perception (primary, secondary and associative visual cortex ), sensory integration , subsequent recognition of arm movement  and attention shifting [57, 58] (posterior parietal cortex), spatial input processing  (inferior parietal cortex: supramarginal gyrus), re-mapping on the somatosensory and motor cortex (postcentral gyrus , precentral gyrus [61, 62] and SMA ), storage in memory (hippocampus and parahippocampal gyrus, temporal areas [64–66] and dorsolateral pre-frontal cortex, see  for a review), motor control and motor learning (cerebellum , hippocampus and parahippocampal gyrus ). As far as the dorsolateral fronto-parietal activations are concerned, a similar pattern was observed when dot trajectories were presented, showing a wide overlapping of areas significantly activated during arm movement and dot trajectory processing, as revealed by a conjunction analysis. However, the larger activations in the lateral and medial occipital and temporal lobes in arm movement presentation with respect to dot trajectory trials, revealed by the AM > DT subtractive analysis, may only in part be explained by the visuo-perceptual differences among the two conditions. Actually, the more intense BOLD signal from lingual and fusiform gyri during the AM condition supports the specific role of these loci in biological movement processing and confirms previous fMRI data [30, 31]. The wider cerebellar involvement in AM reveals the contribution of such a structure to motor activities (see also [30, 32]). Interestingly, no difference was found in the motor and pre-motor areas.
Representation of arm movements and dot trajectories
In each trial, following the presentation of the target, subjects were required to analyse the congruence between the observed arm movement or dot trajectory and the position of the target point. This implies retrieval from memory of the observed movement and imagery of the movement toward the target (both for human arm motor gestures, AMTs, and dot trajectories, DTTs). Results showed activation patterns consistent with data from previous studies [13–18]. The active loci corresponded to those found during movement observation, with the minor differences described in the Results section. Similar to the case of movement observation, a wide overlapping of activated areas for biological and non-biological trials was also found with regard to movement retrieval and imagery. This result was again confirmed by a conjunction analysis. However, more intense parietal cortical activity (superior parietal lobule) was found for AMT than for DTT. Together with premotor and prefrontal cortex, the superior parietal lobule is part of the cerebral network for working memory . In the reverse contrast (DTT > AMT), the differential activations involved occipital and temporal lobes and the cerebellum, which were the same areas that were more activated during AM than DT observation.
While there is convincing evidence about the cerebral structures involved in biological motion processing, it is still not clear whether or not the processing of non-biological movements relies on the same structures. Previous studies have described the specific anatomical networks for the perception of biological movements, compared with non-biological ones [30–33]. However, other works have reported that observing upper limb movements carried out by humanoid robotic devices may generate the same fMRI pattern activated by the observation of a human arm [36–39]. Therefore, a possible explanation of the results provided by the present study would be that dot trajectories (i.e., abstract movements corresponding to the visual feedback in the InMotion2 Robot training) activate the same brain areas involved in the processing (recognition, retrieval and imagery) of the human arm motor gesture. In that case, our data would support the hypothesis that the non-biological feedback is processed in a manner similar to that for the natural motor gesture. As far as the dorsolateral fronto-parietal regions are concerned (in particular motor, pre-motor and sensorimotor areas), these results would enforce the idea that a biological input is not necessarily required [36–39], whereas significant differences mainly involve the lingual and fusiform gyri [30, 31].
The fact that significant areas in the DTT > AMT comparison overlapped (with smaller extension and lower intensity) with those in which activations were stronger during arm movement presentation than during dot trajectory observation (AM > DT; Table 1), would suggest that when participants were seeing the target, and hence had to make the decision on the congruity of the dot trajectory previously seen, they mentally reconstructed the motor gesture that subtends such a trajectory. Therefore, in trials presenting dot trajectories, a more intense effort was required to reconstruct the human gesture generating the corresponding non-biological motion. On the contrary, in case of previous presentation of human arm movements, subjects did not need to actively reconstruct the gesture, since a stored trace was still available in working memory. However, a possible objection could be that such a result may also be related to the characteristics of our experimental design. In the event-related task that was implemented in this study, the presentations of AM and DT trials were randomised, which could have facilitated a strategy based on the recall of the corresponding motor gesture even in case of dot trajectory presentation. In summary, from a rehabilitative point of view, we may speculate that inducing patients with hemiplegia to mentally reconstruct the gestures by requiring an active analysis of the goal of the action, might increase the cerebral haemodynamic response from the network involved in movement processing, with respect to passive stimulation only. This argument implies that the motion analysis of inanimate objects could be more effective than just observing a gesture or requiring the immediate action repetition.
Processing of congruence
Results from the analysis of congruent vs. incongruent trials revealed more intense neural activity in a few cortical areas for congruent conditions. Post hoc analyses demonstrated that such an effect should be ascribed to trials with arm movement presentation. Indeed, in this condition we found greater activity in a network including bilateral cingulate cortex, right inferior and middle frontal gyrus that are involved in the go-signal and in decision control [71–73], SMA and, with a marginal significance, left primary motor and sensorimotor areas that are involved in perception of limb movements and motor imagery [52, 62]. These differences could depend on the task demand characteristics, namely on the fact that participants were asked to mentally count the number of overall congruent conditions. For that reason, congruent information was more relevant for decision with respect to the incongruent one and participants may have repeated and reinforced the mental reconstruction of the congruent gesture to avoid mistakes. Subjects were instructed to count according to the following reasoning: “If congruent trial (regardless biological or non-biological), then update the count”. No reason allows to suppose that they used different strategies for biological and non-biological trials, since congruent trials were counted jointly. The mental counting procedure could account for activation within and around the IPS, since such area is commonly associated with number processing [74–77], and for Broca’s area activation, as far as silent speech production is concerned. With the exclusion of these two areas, there is no reason to ascribe significant cortical activations to a counting process.
The role played by the knowledge of results provided by the feedback during robotic training deserves further consideration. In the fMRI task, the target point was shown after the end of movement observation and it was not superimposed on the motor gesture or dot trajectory. Literature on motor learning suggests that a delayed feedback (i.e., a feedback provided at the end of the action), similar to the one used in our study, increases the processing of the features of performance and promotes a more stable learning than an instantaneous feedback, like the one provided during the InMotion2 Robot training . While this paper addresses the issue of the biological or non-biological nature of the visual feedback, the different effectiveness of continuous vs. delayed feedback during robotic therapy remains unclear.
A visual fMRI task was used to identify the neural pathway associated with the visual processes involved in upper limb motor training performed with the InMotion2 Robot. This study investigated the suitability of non-biological movement presentation, with respect to human movement observation, in activating brain networks for motor processing. Results from healthy adult subjects would support the appropriateness of the visual feedback (movement of a dot) during robotic treatment, while the task does not address whether a continuous feedback is more or less efficient than a feedback based on delayed knowledge of results. However, due to the nature of the task, this study does not take into account some relevant contributions that affect motor control such as motor learning related to the haptic feedback and the aspects of motor execution provided by robotic training. Moreover, the dissociation between the processing of arm movements and abstract object trajectories cannot be fully discarded since its absence in the results could be due to the characteristics of our task, which, similar to what happens during robotic training, may induce the assimilation of strategies for upper limb movement and dot trajectory processing.
Observation of an arm movement
Presentation of a congruent target point following an arm movement
Presentation of an incongruent target point following an arm movement
Presentation of (congruent or incongruent) target points following arm movements (also referred to as “representation of arm movements”)
Presentation of congruent targets (following arm movements or dot trajectories)
Observation of a dot trajectory
Presentation of a congruent target point following a dot trajectory
Presentation of an incongruent target point following a dot trajectory
Presentation of (congruent or incongruent) target points following dot trajectories (also referred to as “representation of dot trajectories”)
Functional magnetic resonance imaging
Presentation of incongruent targets (following arm movements or dot trajectories)
Kinetic occipital area
Montréal neurological institute
Supplementary motor area
Statistical parametric map
Superior temporal sulcus.
Adamovich SV, Fluet GG, Tunik E, Merians AS: Sensorimotor training in virtual reality: a review. Neuro Rehabilitation 2009, 25: 29-44.
Castelli E: Robotic movement therapy in cerebral palsy. Dev Med Child Neurol 2011, 53: 481. 10.1111/j.1469-8749.2011.03987.x
Henderson A, Korner-Bitensky N, Levin M: Virtual reality in stroke rehabilitation: a systematic review of its effectiveness for upper limb motor recovery. Top Stroke Rehabil 2007, 14: 52-61.
Huang VS, Krakauer JW: Robotic neurorehabilitation: a computational motor learning perspective. J Neuroeng Rehabil 2009, 6: 5. 10.1186/1743-0003-6-5
Masia L, Frascarelli F, Morasso P, Di Rosa G, Petrarca M, Castelli E, Cappa P: Reduced short term adaptation to robot generated dynamic environment in children affected by Cerebral Palsy. J Neuroeng Rehabil 2011, 8: 28. 10.1186/1743-0003-8-28
Prange GB, Jannink MJ, Groothuis-Oudshoorn CG, Hermens HJ, Ijzerman MJ: Systematic review of the effect of robot-aided therapy on recovery of the hemiparetic arm after stroke. J Rehabil Res Dev 2006, 43: 171-184. 10.1682/JRRD.2005.04.0076
Waldner A, Tomelleri C, Hesse S: Transfer of scientific concepts to clinical practice: recent robot-assisted training studies. Funct Neurol 2009, 24: 173-177.
Kwakkel G, Kollen BJ, Krebs HI: Effects of robot-assisted therapy on upper limb recovery after stroke: a systematic review. Neurorehabil Neural Repair 2008, 22: 111-121.
Brochard S, Robertson J, Médée B, Rémy-Néris O: What’s new in new technologies for upper extremity rehabilitation? Curr Opin Neurol 2010, 23: 683-687. 10.1097/WCO.0b013e32833f61ce
Binkofski F, Buccino G, Posse S, Seitz RJ, Rizzolatti G, Freund H: A fronto-parietal circuit for object manipulation in man: evidence from an fMRI-study. Eur J Neurosci 1999, 11: 3276-3286. 10.1046/j.1460-9568.1999.00753.x
Kollias SS, Alkadhi H, Jaermann T, Crelier G, Hepp-Reymond MC: Identification of multiple nonprimary motor cortical areas with simple movements. Brain Res Rev 2001, 36: 185-195. 10.1016/S0165-0173(01)00094-7
Lotze M, Markert J, Sauseng P, Hoppe J, Plewnia C, Gerloff C: The role of multiple contralesional motor areas for complex hand movements after internal capsular lesion. J Neurosci 2006, 26: 6096-6102. 10.1523/JNEUROSCI.4564-05.2006
Ryding E, Decety J, Sjöholm H, Stenberg G, Ingvar DH: Motor imagery activates the cerebellum regionally. A SPECT rCBF study with 99mTc-HMPAO. Brain Res Cogn Brain Res 1993, 1: 94-9. 10.1016/0926-6410(93)90015-W
Boecker H, Ceballos-Baumann AO, Bartenstein P, Dagher A, Forster K, Haslinger B, Brooks DJ, Schwaiger M, Conrad B: A H(2)(15)O positron emission tomography study on mental imagery of movement sequences–the effect of modulating sequence length and direction. NeuroImage 2002, 17: 999-1009. 10.1006/nimg.2002.1139
Grèzes J, Decety J: Does visual perception of object afford action? Evidence from a neuroimaging study. Neuropsychologia 2002, 40: 212-22. 10.1016/S0028-3932(01)00089-6
Samuel M, Ceballos-Baumann AO, Boecker H, Brooks DJ: Motor imagery in normal subjects and Parkinson’s disease patients: an H215O PET study. Neuroreport 2001, 12: 821-8. 10.1097/00001756-200103260-00040
Lang W, Cheyne D, Höllinger P, Gerschlager W, Lindinger G: Electric and magnetic fields of the brain accompanying internal simulation of movement. Cogn Brain Res 1996, 3: 125-129. 10.1016/0926-6410(95)00037-2
Beisteiner R, Höllinger P, Lindinger G, Lang W, Berthoz A: Mental representations of movements. Brain potentials associated with imagination of hand movements. Electroencephalogr Clin Neurophysiol 1995, 96: 183-193. 10.1016/0168-5597(94)00226-5
Hwang HJ, Kwon K, Im CH: Neurofeedback-based motor imagery training for brain-computer interface (BCI). J Neurosci Methods 2009, 179: 150-156. 10.1016/j.jneumeth.2009.01.015
Cope SM, Liu XC, Verber MD, Cayo C, Rao S, Tassone JC: Upper limb function and brain reorganization after constraint-induced movement therapy in children with hemiplegia. Dev Neurorehabil 2010, 13: 19-30. 10.3109/17518420903236247
Gauthier LV, Taub E, Perkins C, Ortmann M, Mark VW, Uswatte G: Remodeling the brain: plastic structural brain changes produced by different motor therapies after stroke. Stroke 2008, 39: 1520-1525. 10.1161/STROKEAHA.107.502229
Sutcliffe TL, Gaetz WC, Logan WJ, Cheyne DO, Fehlings DL: Cortical reorganization after modified constraint-induced movement therapy in pediatric hemiplegic cerebral palsy. J Child Neurol 2007, 22: 1281-1287. 10.1177/0883073807307084
Takahashi CD, Der-Yeghiaian L, Le V, Motiwala RR, Cramer SC: Robot-based hand motor therapy after stroke. Brain 2008, 131: 425-37. 10.1093/brain/awm311
Price CJ, Crinion J, Friston KJ: Design and analysis of fMRI studies with neurologically impaired patients. J Magn Reson Imaging 2006, 23: 816-26. 10.1002/jmri.20580
Buccino G, Binkofski F, Fink GR, Fadiga L, Fogassi L, Gallese V, Seitz RJ, Zilles K, Rizzolatti G, Freund HJ: Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. Eur J Neurosci 2001, 13: 400-404.
Jeannerod M: Neural simulation of action: a unifying mechanism for motor cognition. NeuroImage 2001, 14: S103-9. 10.1006/nimg.2001.0832
Rizzolatti G, Craighero L: The mirror-neuron system. Annu Rev Neurosci 2004, 27: 169-192. 10.1146/annurev.neuro.27.070203.144230
Ertelt D, Small S, Solodkin A, Dettmers C, McNamara A, Binkofski F, Buccino G: Action observation has a positive impact on rehabilitation of motor deficits after stroke. NeuroImage 2007,36(Suppl 2):164-173.
Franceschini M, Agosti M, Cantagallo A, Sale P, Mancuso M, Buccino G: Mirror neurons: action observation treatment as a tool in stroke rehabilitation. Eur J Phys Rehabil Med 2010, 46: 517-523.
Vaina LM, Solomon J, Chowdhury S, Sinha P, Belliveau JW: Functional neuroanatomy of biological motion perception in humans. Proc Natl Acad Sci USA 2001, 98: 11656-61. 10.1073/pnas.191374198
Servos P, Osu R, Santi A, Kawato M: The neural substrates of biological motion perception: an fMRI study. Cereb Cortex 2002, 12: 772-782. 10.1093/cercor/12.7.772
Grossman E, Donnelly M, Price R, Pickens D, Morgan V, Neighbor G, Blake R: Brain areas involved in perception of biological motion. J Cogn Neurosci 2000, 12: 711-720. 10.1162/089892900562417
Morris JP, Pelphrey KA, McCarthy G: Perceived causality influences brain activity evoked by biological motion. Soc Neurosci 2008, 3: 16-25. 10.1080/17470910701476686
Buccino G, Lui F, Canessa N, Patteri I, Lagravinese G, Benuzzi F, Porro CA, Rizzolatti G: Neural circuits involved in the recognition of actions performed by nonconspecifics: an fMRI study. J Cogn Neurosc 2004, 16: 114-126. 10.1162/089892904322755601
Costantini M, Galati G, Ferretti A, Caulo M, Tartaro A, Romani GL, Aglioti SM: Neural systems underlying observation of humanly impossible movements: an FMRI study. Cereb Cortex 2005, 15: 1761-1767. 10.1093/cercor/bhi053
Engel A, Burke M, Fiehler K, Bien S, Rosler F: How moving objects become animated: the human mirror neuron system assimilates non-biological movement patterns. Soc Neurosci 2008, 3: 368-387. 10.1080/17470910701612793
Gazzola V, Rizzolatti G, Wicker B, Keysers C: The anthropomorphic brain: the mirror neuron system responds to human and robotic actions. Neuro Image 2007, 35: 1674-1684.
Press C, Bird G, Flach R, Heyes C: Robotic movement elicits automatic imitation. Cogn Brain Res 2005, 25: 632-640. 10.1016/j.cogbrainres.2005.08.020
Saygin AP, Chaminade T, Ishiguro H, Driver J, Frith C: The thing that should not be: predictive coding and the uncanny valley in perceiving human and humanoid robot actions. Soc Cogn Affect Neurosci 2011. Epub 22 Apr 2011
Buckner RL: The hemodynamic inverse problem: making inferences about neural activity from measured MRI signals. Proc Natl Acad Sci USA 2003, 100: 2177-2179. 10.1073/pnas.0630492100
Shibasaki H: Human brain mapping: hemodynamic response and electrophysiology. Clin Neurophysiol 2008, 119: 731-43. 10.1016/j.clinph.2007.10.026
Krebs HI, Hogan N, Aisen ML, Volpe BT: Robot-aided neurorehabilitation. IEEE Trans Rehabil Eng 1998, 6: 75-87. 10.1109/86.662623
Sgandurra G, Ferrari A, Cossu G, Guzzetta A, Biagi L, Tosetti M, Fogassi L, Cioni G: Upper limb children action-observation training (UP-CAT): a randomised controlled trial in Hemiplegic Cerebral Palsy. BMC Neurol 2011, 11: 80. 10.1186/1471-2377-11-80
Small SL, Buccino G, Solodkin A: The mirror neuron system and treatment of stroke. Dev Psychobiol . Epub 24 Nov 2010
Friston KJ, Holmes AP, Worsley KJ: How many subjects constitute a study? NeuroImage 1999, 10: 1-5. 10.1006/nimg.1999.0439
Forman SD, Cohen JD, Fitzgerald M, Eddy WF, Mintun MA, Noll DC: Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold. Magn Reson Med 1995, 33: 636-647. 10.1002/mrm.1910330508
Nichols T, Brett M, Andersson J, Wagner T, Poline JB: Valid conjunction inference with the minimum statistic. NeuroImage 2005, 25: 653-660. 10.1016/j.neuroimage.2004.12.005
Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M: Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage 2002, 15: 273-289. 10.1006/nimg.2001.0978
Boyd LA, Vidoni ED, Siengsukon CF, Wessel BD: Manipulating time-to-plan alters patterns of brain activation during the Fitts’ task. Exp Brain Res 2009, 194: 527-539. 10.1007/s00221-009-1726-4
Cunnington R, Windischberger C, Deecke L, Moser E: The preparation and readiness for voluntary movement: a high-field event-related fMRI study of the Bereitschafts-BOLD response. NeuroImage 2003, 20: 404-412. 10.1016/S1053-8119(03)00291-X
Goodyear BG, Douglas EA: Decreasing task-related brain activity over repeated functional MRI scans and sessions with no change in performance: implications for serial investigations. Exp Brain Res 2009, 192: 231-239. 10.1007/s00221-008-1574-7
Hanakawa T, Dimyan MA, Hallett M: Motor planning, imagery, and execution in the distributed motor network: a time-course study with functional MRI. Cereb Cortex 2008, 18: 2775-2788. 10.1093/cercor/bhn036
Jäncke L, Lutz K, Koeneke S: Converging evidence of ERD/ERS and BOLD responses in motor control research. Prog Brain Res 2006, 159: 261-271.
Waberski TD, Gobbelé R, Lamberty K, Buchner H, Marshall JC, Fink GR: Timing of visuo-spatial information processing: electrical source imaging related to line bisection judgements. Neuropsychologia 2008, 46: 1201-10. 10.1016/j.neuropsychologia.2007.10.024
Fink GR, Marshall JC, Halligan PW, Frith CD, Driver J, Frackowiak RS, Dolan RJ: The neural consequences of conflict between intention and the senses. Brain 1999, 122: 497-512. 10.1093/brain/122.3.497
Ohgami Y, Matsuo K, Uchida N, Nakai T: An fMRI study of tool-use gestures: body part as object and pantomime. Neuroreport 2004, 15: 1903-6. 10.1097/00001756-200408260-00014
Caplan JB, Luks TL, Simpson GV, Glaholt M, McIntosh AR: Parallel networks operating across attentional deployment and motion processing: a multi-seed partial least squares fMRI study. NeuroImage 2006, 29: 1192-202. 10.1016/j.neuroimage.2005.09.010
Corbetta M, Kincade JM, Ollinger JM, McAvoy MP, Shulman GL: Voluntary orienting is dissociated from target detection in human posterior parietal cortex. Nat Neurosci 2000, 3: 292-7. Erratum in: Nat Neurosci 2000, 3:521 10.1038/73009
Amorapanth PX, Widick P, Chatterjee A: The neural basis for spatial relations. J Cogn Neurosci 2010, 22: 1739-53. 10.1162/jocn.2009.21322
Ebisch SJ, Perrucci MG, Ferretti A, Del Gratta C, Romani GL, Gallese V: The sense of touch: embodied simulation in a visuotactile mirroring mechanism for observed animate or inanimate touch. J Cogn Neurosci 2008, 20: 1611-23. 10.1162/jocn.2008.20111
Binkofski F, Fink GR, Geyer S, Buccino G, Gruber O, Shah NJ, Taylor JG, Seitz RJ, Zilles K, Freund HJ: Neural activity in human primary motor cortex areas 4a and 4p is modulated differentially by attention to action. J Neurophysiol 2002, 88: 514-9.
Naito E: Sensing limb movements in the motor cortex: how humans sense limb movement. Neuroscientist 2004, 10: 73-82. 10.1177/1073858403259628
Rumiati RI, Weiss PH, Tessari A, Assmus A, Zilles K, Herzog H, Fink GR: Common and differential neural mechanisms supporting imitation of meaningful and meaningless actions. J Cogn Neurosci 2005, 17: 1420-31. 10.1162/0898929054985374
Powell HW, Koepp MJ, Symms MR, Boulby PA, Salek-Haddadi A, Thompson PJ, Duncan JS, Richardson MP: Material-specific lateralization of memory encoding in the medial temporal lobe: blocked versus event-related design. NeuroImage 2005, 27: 231-9. 10.1016/j.neuroimage.2005.04.033
Machielsen WC, Rombouts SA, Barkhof F, Scheltens P, Witter MP: FMRI of visual encoding: reproducibility of activation. Hum Brain Mapp 2000, 9: 156-64. 10.1002/(SICI)1097-0193(200003)9:3<156::AID-HBM4>3.0.CO;2-Q
Maguire EA, Mummery CJ, Büchel C: Patterns of hippocampal-cortical interaction dissociate temporal lobe memory subsystems. Hippocampus 2000, 10: 475-82. 10.1002/1098-1063(2000)10:4<475::AID-HIPO14>3.0.CO;2-X
Fletcher PC, Henson RN: Frontal lobes and human memory: insights from functional neuroimaging. Brain 2001, 124: 849-81. 10.1093/brain/124.5.849
Manto M, Bower JM, Conforto AB, Delgado-García JM, da Guarda SN, Gerwig M, Habas C, Hagura N, Ivry RB, Mariën P, Molinari M, Naito E, Nowak DA, Oulad Ben Taib N, Pelisson D, Tesche CD, Tilikete C, Timmann D: Consensus paper: roles of the cerebellum in motor control-the diversity of ideas on cerebellar involvement in movement. Cerebellum Epub 13 Dec 2011
Albouy G, Sterpenich V, Balteau E, Vandewalle G, Desseilles M, Dang-Vu T, Darsaud A, Ruby P, Luppi PH, Degueldre C, Peigneux P, Luxen A, Maquet P: Both the hippocampus and striatum are involved in consolidation of motor sequence memory. Neuron 2008, 58: 261-72. 10.1016/j.neuron.2008.02.008
Clayton EC, D’Esposito M: Functional neuroimaging of working memory. In Handbook of Functional Neuroimaging of Cognition. 2nd edition. Edited by: Cabeza R, Kingstone A. MIT Press, Cambridge MA; 2006:269-306.
Chevrier AD, Noseworthy MD, Schachar R: Dissociation of response inhibition and performance monitoring in the stop signal task using event-related fMRI. Hum Brain Mapp 2007, 28: 1347-1358. 10.1002/hbm.20355
Kemmotsu N, Villalobos ME, Gaffrey MS, Courchesne E, Müller RA: Activity and functional connectivity of inferior frontal cortex associated with response conflict. Brain Res Cogn Brain Res 2005, 24: 335-342. 10.1016/j.cogbrainres.2005.02.015
Kübler A, Dixon V, Garavan H: Automaticity and reestablishment of executive control-an fMRI study. J Cogn Neurosci 2006, 18: 1331-1342. 10.1162/jocn.2006.18.8.1331
Dehaene S: The organization of brain activations in number comparison: event-related potentials and the additive-factors methods. J Cogn Neurosc 1996, 8: 47-68. 10.1162/jocn.19184.108.40.206
Fias W, Lammertyn J, Reynvoet B, Dupont P, Orban GA: Parietal representation of symbolic and nonsymbolic magnitude. J Cogn Neurosc 2003, 15: 47-56. 10.1162/089892903321107819
Nieder A, Freedman DJ, Miller EK: Representation of the quantity of visual items in the primate prefrontal cortex. Science 2002, 297: 1708-1711. 10.1126/science.1072493
Zorzi M, Di Bono MG, Fias W: Distinct representations of numerical and non-numerical order in the human intraparietal sulcus revealed by multivariate pattern recognition. NeuroImage 2011, 56: 674-680. 10.1016/j.neuroimage.2010.06.035
Swinnen SP, Schmidt RA, Nicholson DE, Shapiro DC: Information feedback for skill acquisition: Instantaneous knowledge of results degrades learning. J Exp Psychol Learn Mem Cogn 1990, 16: 706-716.
The authors wish to thank Dr. Marcello Costantini for his precious suggestions and comments.
The work was supported by the Italian Ministry of Health (Grant 2010), and co-funded by the Italian 5x1000 contribution 2008.
P. Cappa acknowledges the financial support of the Italian Ministry of Education, University, and Scientific Research (Grant 2006 International University Cooperation “Robot-mediated therapy”) and the Italian Ministry of Health (Grant 2007 “Pilot study on a novel typology of medical devices: robotic systems for rehabilitation and tele-rehabilitation”).
The authors have not competing interests as defined by the BioMed Central Publishing Group, or other interests that may influence results and discussion reported in this study.
FN contributed to conception and design, test conduction, data acquisition, data analysis and writing. SG contributed to conception and design, test conduction, data acquisition, interpretation of data and writing. CG contributed to test conduction, interpretation of data and writing. MP contributed to conception and design, test conduction, interpretation of data and writing. VC, PC, TD, EC participated in design, acquisition of founding and coordination of the research. All authors read and approved the final manuscript.
Federico Nocchi, Simone Gazzellini contributed equally to this work.
About this article
Cite this article
Nocchi, F., Gazzellini, S., Grisolia, C. et al. Brain network involved in visual processing of movement stimuli used in upper limb robotic training: an fMRI study. J NeuroEngineering Rehabil 9, 49 (2012) doi:10.1186/1743-0003-9-49
- Robot-mediated therapy
- Motor processing
- Upper limb rehabilitation