Skip to main content

Robotically facilitated virtual rehabilitation of arm transport integrated with finger movement in persons with hemiparesis



Recovery of upper extremity function is particularly recalcitrant to successful rehabilitation. Robotic-assisted arm training devices integrated with virtual targets or complex virtual reality gaming simulations are being developed to deal with this problem. Neural control mechanisms indicate that reaching and hand-object manipulation are interdependent, suggesting that training on tasks requiring coordinated effort of both the upper arm and hand may be a more effective method for improving recovery of real world function. However, most robotic therapies have focused on training the proximal, rather than distal effectors of the upper extremity. This paper describes the effects of robotically-assisted, integrated upper extremity training.


Twelve subjects post-stroke were trained for eight days on four upper extremity gaming simulations using adaptive robots during 2-3 hour sessions.


The subjects demonstrated improved proximal stability, smoothness and efficiency of the movement path. This was in concert with improvement in the distal kinematic measures of finger individuation and improved speed. Importantly, these changes were accompanied by a robust 16-second decrease in overall time in the Wolf Motor Function Test and a 24-second decrease in the Jebsen Test of Hand Function.


Complex gaming simulations interfaced with adaptive robots requiring integrated control of shoulder, elbow, forearm, wrist and finger movements appear to have a substantial effect on improving hemiparetic hand function. We believe that the magnitude of the changes and the stability of the patient's function prior to training, along with maintenance of several aspects of the gains demonstrated at retention make a compelling argument for this approach to training.


Sensorimotor impairments and participation restrictions remain a pervasive problem for patients post stroke, with recovery of upper extremity function particularly recalcitrant to intervention. 80% to 95% of persons demonstrate residual upper extremity impairments lasting beyond six months after their strokes [1]. One of the issues that may contribute to less than satisfactory outcomes for the upper extremity is the complexity of sensory processing and motor output involved in normal hand function. There is a vital need to develop rehabilitative training strategies that will improve functional outcomes and real-world use of the arm and hand. In an attempt to address this need, many researchers are developing robotic-assisted arm training devices in concert with strategically placed virtual targets or complex virtual reality gaming simulations. Integrated whole arm activities are difficult because most robotic devices are designed for upper arm motion and not for grasp and fine motor activities. An additional hurdle stems from multiple lines of inquiry in animal and human motor learning and neuroplasticity literature, that indicate that sufficient task complexity seems to be a factor in upper extremity motor skill development and cortical plasticity [25], requiring more complex training activities than those typically seen in the robotic rehabilitation literature.

In an effort to improve upper extremity outcomes post-stroke we have concentrated on hand training. Our past work has used virtual reality gaming simulations to exercise finger movements of a stationary hand, including functional individual finger motions and whole hand opening/closing, to interact with simple interactive virtual environments. Subjects showed improvement in the kinematics of the movements as well as in dexterity as measured by clinical tests of hand function [68]. This intervention utilized current neurophysiological findings regarding the importance of repetitive, frequent and intensive practice for skill development and motor recovery [913].

As we do not know the best training strategy to facilitate recovery of hand function and recognizing the neural interaction of arm and hand and the importance of training using functionally complex movements, we asked the question whether training the arm and hand in an integrated manner would promote better motor recovery outcomes than previously reported hand-only training. In this paper we describe a study that used interactive gaming simulations interfaced with adaptive robots to provide a multi-faceted environment to test the assumption that training the entire upper extremity, including fingers, as a unit will improve the hemiparetic hand of patients post-stroke and importantly that the kinematic changes gained through this type of practice would transfer to untrained real world arm/hand activities.




All simulations in this study utilized CyberGlove© (Immersion) instrumented gloves for hand tracking. A CyberGrasp© (Immersion), a lightweight, force-reflecting exoskeleton that fits over the CyberGlove was used to facilitate individual finger movement in patients with more pronounced deficits. Two of the four simulations use the Flock of Birds (Ascension Technologies) motion sensors for arm tracking and the other two use the Haptic Master robot (Moog FCS Corporation). Please see [14, 15] for full description of the hardware.


Four gaming simulations were developed. All four simulations integrate components of upper arm movement with wrist and hand movement. Plasma Pong© (Steve Taylor, 2007) was adopted from an existing game in which the game control was transferred from the computer mouse to the CyberGlove. In this game (Figure 1a), the pong paddle is moved vertically using shoulder flexion/extension while the moving ball is engaged horizontally, using rapid finger extension. The Hummingbird Hunt simulation depicts a hummingbird moving through an environment filled with trees, flowers and a river (Figure 1b), providing practice in the composite movement of arm transport, hand-shaping and grasp. A pincer grip is used to catch and release the bird while it is positioned in different locations of a 3D workspace. The Hammer Task (Figure 1c) trains a combination of three dimensional reaching and repetitive finger flexion/extension. The subjects reach toward a virtual wooden cylinder, stabilize their upper arm and then use either finger extension or flexion to hammer the cylinders into the floor. The Virtual Piano simulation consists of a complete virtual piano (Figure 1d) that plays the appropriate notes as they are pressed by the virtual fingers using the CyberGlove with or without the CyberGrasp. Please see [7, 16] for full description of the simulations. Figure 1e shows the experimental set-up for the integration of the Haptic Master robot, the arm supporting gimbal and the CyberGlove.

Figure 1
figure 1

Simulations. Screen shots for simulations utilized during this training study a. Plasma Pong, b. Hummingbird Hunt, c. Hammer Task, d. Virtual Piano. e. Training setup.


Twelve subjects (8 male, 4 female), mean (SD) age of 55 (14) years, and mean (SD) time post stroke of 5 (5) years, (range 9 months to 15 years) participated in this study. Inclusion criteria were subjects at least 6 months post-stroke, wrist extension of at least 10°, finger extension of 10° and not receiving any other therapy at the time of the study. Exclusion criteria included severe aphasia, hemispatial neglect and botulinum toxin injections within the past 3 months. The Chedoke McMaster Arm (CMA) and Hand (CMH) Impairment Inventories [17] and a composite of upper extremity Ashworth scores were used to categorize the impairment levels of the subjects (see Table 1 for demographic and impairment data). Consent was obtained from all subjects and the Internal Review Boards of both universities approved the protocol. Subjects trained on all four simulations during 2-3 hour sessions for eight days. Training was divided equally between the four simulations. Total training time started on day one at two hours and increased in fifteen-minute increments during Week 1. Training time started and remained at three hours on all four days of Week 2.

Table 1 Subject characteristics


Two timed clinical tests served as our primary outcome measures: Jebsen Test of Hand Function (JTHF) and Wolf Motor Function Test (WMFT) [18, 19]. Both the impaired and unimpaired arm/hand were tested for each clinical test. For the WMFT 120 seconds were recorded when the subject could not perform the subtest [20], while for the JTHF we used 45 sec as a score for a failed subtest. Similar to other reported studies, we eliminated the writing component of the JTHF [6, 21]. In each session, the JTHF was administered three times and the mean of the three scores was used for analysis. Stroke subjects were tested prior to training, immediately post training and at least three months after training. Subjects were at least 6 months post-stroke and reported to be neurologically stable. To confirm the stability of their motor function and absence of confounding spontaneous recovery, for each clinical test, we conducted two baseline tests on a subset (N = 8), of the twelve subjects with stroke, two weeks before and one day before the onset of training. In addition, seven age-matched, neurologically healthy subjects performed the JTHF, three times, at two- week intervals, three times per session.

The secondary measures were the kinematic measures obtained from the Hammer task and the Virtual Piano. We have designed the simulation tasks to have both discrete and continuous movements. The Virtual Piano and the Hammer Task consist of discrete movements with a definite beginning and end, making them more amenable to kinematic analyses. For the Hammer task, these included, hand-path length, maximal extension of the Metacarpal-phalangeal joints (MPJ), time to complete the task (duration) which includes the reaching and hammering phase for each cylinder, the smoothness of the hand trajectory and the deviation of the wrist position in 3D space during hammering [22]. Smoothness of the trajectories was evaluated by integrating the third derivative of the trajectory length. This numerically describes the ability to produce smooth, coordinated, reaching movements [14, 23]. Hand deviation was measured as the mean distance of the hand from the target during hammering (using finger flexion and extension) and is considered a measure of proximal stability and shoulder stabilization during hand-object interaction [22]. For the Virtual Piano, kinematic measures included accuracy, measured by the percent of correct key presses, time to complete the task (duration), which includes both hand transport and key press time for each note in the song, and fractionation, the ability to isolate the movement of each finger, measured as the difference in MCP joint angle between the cued finger and the most flexed non-cued finger.

Data Analysis

The subjects were evaluated three times on the primary outcome measures, with two pre-planned contrasts: Pre-test minus Post-test, and Pre-test minus Retention-test. Data sets for pre-test, post-test and retention were each evaluated for normality using the Kolmogorov-Smirnov Test. While JTHF scores were normally distributed (p > 0.20), scores for the WMFT were positively skewed (p < 0.1) because of two of the most involved subjects. We have performed all statistical tests using clinical scores of all 12 subjects, as well as of 10 subjects (with the two most involved subjects removed), with similar results. Therefore, we will report the outcomes of parametric statistical tests on all 12 subjects. At the same time, the Pre_minus_Post and Pre_ minus_Retention differences in the WMFT and JTHF clinical scores of the 12 subjects were normally distributed (p > 0.2). Therefore, we will use these data to compare the mean percent improvement between the Pre-test and Post-test scores demonstrated by subjects in this study with those in our previous studies (see Discussion).

For the clinical measures, first, the combined scores of the two tests (WMFT, JTHF) were subjected to a repeated measures ANOVA with factors Test (JTHF, WMFT) and Measurement Time (Pre-test, Post-test, Retention). The Pre-test score was calculated as an average of the two baseline scores for subjects with two pre-training measurements obtained two weeks and one day before the training. Preplanned post-hoc comparisons, Pre-test versus Post-test and Pre-test versus Retention were made for the combined clinical test using two separate, repeated measures ANOVAs with repeated measures of Test (JTHF, WMFT) and Measurement Time (Pre-test, Post-test) or Measurement Time (Pre-test, Retention). The degrees of freedom for all ANOVA tests were adjusted using Greenhouse-Geisser corrections. Finally, preplanned post-hoc comparisons, Pre-test versus Post-test and Pre-test versus Retention were made using two separate, repeated measures ANOVAs for each of the two tests. Eta-squared statistics were used to calculate estimates of effect sizes for group comparisons.

All the kinematic measurements described above were normally distributed. To derive a start measure (SM), performance scores were pooled over the first two days of therapy in order to enhance data stability and reduce potential effects due to subjects acclimating to the robotic system and the virtual environments on Day 1. Performance scores from the last two days were also pooled to obtain a larger data sample for enhanced data stability of the end measure (EM) [6, 24]. For the Hammer Task four separate repeated measures ANOVAs with factor, Measurement Time (SM, EM) were used to evaluate changes in arm kinematics (Duration, Hand Path Length, Smoothness and Hand Deviation). For the Piano task, three separate repeated measures ANOVAs with factor, Measurement Time (SM, EM) were used to evaluate changes in hand kinematics (Fractionation, Duration, Accuracy).

The percent change in the mean clinical scores was calculated as 100 multiplied by the difference between Pre-test and Post-test mean scores, divided by Pre-test mean score. This allowed for a comparison with the outcomes of a former study where we used the previous version of our VR training system [6]. For kinematic measures, the percent changes were calculated in similar fashion using starting measure SM and end measure EM as described above.


Kinematic Analyses

Figure 2 displays the group average daily change in the Piano task for finger fractionation (2a), average movement duration for each note in a song (2b), accuracy of key presses (2c). Two subjects needed to use haptic assistance from the CyberGrasp for this activity and were therefore eliminated from the group calculations for fractionation (ability to isolate their finger movement). As a group the other ten subjects significantly improved in fractionation (Table 2) showing a 39% change. There was a significant improvement in the time to complete the task showing a 19% change without a subsequent change in accuracy (Table 2), indicating that the subjects were able to do the task faster without a substantive change in accuracy. This is thought to be consistent with motor learning [25].

Figure 2
figure 2

Piano trainer kinematic analyses. a. Daily averages during Virtual Piano training for finger fractionation defined as the difference between the angle of the MCP joint of the cued finger and of the most flexed non-cued finger. Higher scores indicate better performance. Averages for 10 subjects are shown (two subjects who used the CyberGrasp haptic device during virtual piano training are not included in this analysis). 2b. Daily averages for all 12 subjects in the time to press each key during piano training. 2c.Daily averages of number of correct keys pressed divided by total keys pressed for all 12 subjects. Error bars = Standard Error of the Mean.

Table 2 Kinematic variables

Figure 3 summarizes group changes during the Hammer task in the hand path length (3a), duration (3b), smoothness of the arm trajectories (3c), peak MPJ extension (3d), group changes in hand deviation (3e) and individual subject improvement in hand deviation (3f). There was a significant decrease in four of the five kinematic variables (Table 2). The time needed to complete each hammering task decreased, showing a 47% change. The hand path decreased in length, by 41% and improved in smoothness by 76%. The improvement in movement time and path length appears to be related to changes in proximal segment function as finger extension (3d), did not change significantly. A decrease in end-point deviation is an indicator of proximal stability. As a group, the subjects improved the proximal stability of the arm while the fingers were repeatedly extending during the hammering task (Table 2), showing a 51% change. Figure 3f indicates that eleven of the twelve subjects improved in this measure with smaller bars indicating less superfluous proximal segment movement while distal segments interacted with the target. Lang cites the ability to maintain proximal segments stationary during distal task performance as an important construct in overall upper extremity functional ability [26].

Figure 3
figure 3

Hammer simulation kinematic analyses. Daily average for all twelve subjects during Hammer Task training in a. the length of the path required to complete ten targets. b. time required to hammer each virtual cylinder c. in hand trajectory smoothness quantified as normalized integrated jerk (values are dimensionless, lower scores indicate smoother path with fewer subunits). d. peak finger extension. 3e. hand deviation calculated as the cumulative excursion of the hand position in 3D space from the center of the target starting at the time target is acquired until completion of hammering (lower scores indicate more stability). 3f. Individual subjects start measure (average of first two training days), and end measure (average of last two training days) for all twelve subjects in average hand deviation during hammer task training. Error bars = Standard Error of the Mean.

Clinical Analyses

First, we evaluated the effects of training on the combined clinical score of the two timed tests (WMFT, JTHF) that served as our primary outcome measures. The repeated measures ANOVA showed a significant effect of Measurement Time (F(2,22) = 13.2, G-G adjusted p = 0.002, partial eta-squared 0.55, observed power (at alpha = 0.05) equal to 0.99), with no significant Clinical Test × Measurement Time interaction. The subsequent separate ANOVAs with a repeated factor Measurement Time (Pre-test, Post-test, Retention) demonstrated statistically significant effects of training for each individual clinical test, WMFT (F(2,22) = 8.35, G-G adjusted p = 0.01, eta squared = 0.43, observed power 0.94) and JTHF (F(2,22) = 9.92, G-G adjusted p = 0.001, eta squared = 0.47, observed power 0.97). Finally, both pre-planned post hoc comparisons (Pre-test versus Post-test and Pre-test versus Retention) for each of the two individual clinical tests were also significant (Table 3). As a group, the 12 subjects showed a percent improvement from Pre-test to Post-test of 22% in the WMFT (eta squared = 0.83) and 20% in the JTHF (eta squared = 0.71).

Table 3 Training Effects for Clinical Tests

In a separate analysis on a subset of eight subjects, we verified the absence of spontaneous recovery by conducting two baseline tests, two weeks before and one day before the beginning of the training. Scores for both WMFT and JTHF were normally distributed (Kolmogorov-Smirnov normality test, p > 0.10). A repeated measures ANOVA with factors Clinical Test (WMFT, JTHF) × Measurement Time (Pre-test 1, Pre-test 2, Post-test, Retention) showed a significant effect of Time (F(3,21) = 10.7; G-G adjusted p = 0.001). Pre-planned post-hoc tests (Pre-test 1 versus Pre-test 2 and Pre-test 2 versus Post-test) showed no difference between the Pre-test 1 and Pre-test 2 for the composite clinical test (F(1,7) = 0.73, p = 0.42) while the composite clinical score at Post-test was significantly better than at Pre-test 2 (F(1,7) = 12.75, p = 0.009). The interaction effect of Clinical Test × Measurement Time was non-significant. Separate repeated measures ANOVAs showed no significant difference in the baseline scores between Pre-test 1 and Pre-test 2 in any of the clinical tests. Mean (SD) scores for WMFT were equal to 53.6 (15.6) and 54.6 (11.0); and for JTHF were equal to 100.3 (38.8) and 103.4 (36.4), respectively. At the same time, Post-test mean (SD) scores were significantly better: 40.0 (8.4) for WMFT and 84.6 (39.0) for JTHF. These analyses indicate the stability of the subjects' motor function prior to training as evaluated by our two clinical tests.

Interpretive measures of clinical outcomes

Six out of 12 subjects demonstrated a percent improvement in their WMFT scores after 8 days of intensive training larger than 30% (range: 30-41), while the other half demonstrated smaller but still substantial percent improvement (range: 10-24). The mean (95% CI) decrease of 16 (13-22) sec in the WMFT time substantially exceeds the reported group change of 2 seconds needed to be regarded as a clinically important difference on the WMFT [27]. To indicate a true change for an individual subject in the time to complete the WMFT, that is a change beyond possible measurement error, the difference in score of an individual subject has to reach 4.36 sec [27]. In this study each subject exceeded the minimum detectable change of 4.36 seconds (range 5.7 to 33.2 sec). Additionally, Wolf et al. [28] cite the completion of an item on a clinical test of upper extremity function at post-test, which a subject was unable to complete at pre-test, as a clinically significant change. One subject was unable to complete the checker task at pre-test but was able to do it at the retention test. This same subject was also unable to complete the picking up small objects and self feeding tasks of the JTHF at pre-test but did complete them at post-test and retention. It is interesting to note that these changes in hand dexterity were observed in both clinical tests.

To evaluate the functional relevance of the observed improvement in the JTHF scores, we compared the performance of the hemiparetic arm with that of the arm ipsilateral to the lesion, as well as with the scores of nine age-matched, neurologically healthy controls (Figure 4). All subjects were tested on three separate occasions, with two weeks between the tests. The control subjects were able to complete the six activities of the JTHF on average in 33 (95% CI: 29-38) sec using their dominant hand and in 36 (31-41) sec using their non-dominant hand. The subjects with stroke required 49 (41-57) sec to complete the six activities using their uninvolved hand and when using their impaired hand, improved from 122 (90-154) sec to 98 (66-129) sec after training. Measures for the uninvolved hand and the controls were stable across the three time frames with only the hemiparetic hand showing improved scores after training.

Figure 4
figure 4

Jebsen test of hand function comparison. The composite time for the Jebsen Test of Hand Function at three testing points for the 12 subjects with strokes (JTHF1 = Pre-test, JTHF2 = Post-test, JTHF3 = Retention, Impaired Hand = open circles, Unimpaired Hand = solid circles), and the seven aged matched controls (Non-Dominant Hand = open triangles, Dominant hand = solid triangles). Error bars = Standard Error of the Mean.

It is believed that patients in the chronic phase post-stroke, in general, are less physically active and do not receive physical or occupational therapy. Therefore, there is some concern that positive results of training studies are due mainly to the large increase of activity afforded by the training. To explore the impact of inactivity on response to the intervention, we compared pre-post-retention changes on the WMFT and the JTHF between the subjects who had received physical therapy within a three month period prior to beginning this study (previously active group, N = 6, therapeutic intervention within 3 months) and those who had not had therapy for a longer time (previously inactive group, N = 6, median time post therapeutic intervention = 14 mos.). We evaluated the effects of training on the combined clinical score of the two timed tests (WMFT, JTHF), using a repeated measures ANOVA with a between factor Group (previously active, inactive) and a within factor Measurement time (Pre-test, Post-test, Retention). There was no difference between the two groups (F(1,10) = .06; p = 0.82). Moreover, the Group by Measurement time interaction was not significant (F(2,20) = .260; p = 0.77). These results indicate that the prior level of activity did not affect the outcome of the training.


In this study we tested a rehabilitation paradigm that simultaneously exercised the arm and hand, including the fingers, in an integrated manner using virtual reality task-based gaming simulations. Our goal was to improve hemiparetic hand function in patients in the chronic phase post-stroke. As a group, the subjects were able to more effectively control the upper limb during reaching and hand interaction with the target as demonstrated by improved proximal stability, smoothness and efficiency of the movement path. The improvements in smoothness are indicative of a decrease in the number of sub-movements required to complete the transport phase of the motion. Several authors cite this pattern of change as consistent with improvements in neuromotor control [9, 23]. This improved control was in concert with improvement in the distal kinematic measures of fractionation and improved speed. Of note, these changes in robotic measures were accompanied by robust changes in the clinical outcome measures.

Several factors may have influenced the findings in this study. Congruent with the motor learning and neuroplasticity literature, it is believed that the acquisition of a motor skill follows a dose-response relationship [29]. In rehabilitation, the dose is often measured as the number of task repetitions or practice hours. Multiple authors cite the ability of robotically facilitated training to provide highly repetitious training as a key factor for its effectiveness [30, 31]. The comparison between the training volume typical to robotic interventions and those of traditional UE interventions is marked. Subjects average over 500 repetitions/day in studies in the robotic rehabilitation literature [3234] while an observational study of the repetitions performed in a traditional outpatient setting averaged 85 [35]. The average number of repetitions during the two to three hour training sessions used in this study exceeded 2200.

Based upon a review of 20 RCT's, it has been suggested that a minimal dose of at least sixteen hours of practice is required to achieve functional changes [29]. Our subjects performed 22 hours of training, 10 hours during week one and 12 hours in the longer sessions in week two. Each training session in this study was considerably longer than the twenty to ninety minute sessions described in the current robotic literature [30, 31] and was delivered within a more concentrated time period [11, 34, 3638].

Another factor to consider is that the gaming simulations structured the subjects' attentional focus. It has been shown in people with and without disabilities that the learning of a motor task is more effective when attention is focused on externally rather than on internally based directions [39, 40]. In these virtual reality simulations, practice was directed to achieve action goals rather than performing specific movements. The instructions for the game, the feedback provided and the inherent structure of each simulation directed the players' attention to the task to be achieved. In other words, the focus of attention was on the effect of one's movements rather than on the movement itself.

The largest improvements demonstrated with the Virtual Piano were for finger fractionation, which is the ability to flex one finger independently of the other fingers. During practice, the performance feedback, the sound of the appropriate note, occurs when a fractionation target is achieved, reinforcing this construct. In addition fractionation is also specifically reinforced with an adaptive algorithm that increases and decreases the fractionation target, based on the subjects' performance. This algorithm which is described in detail elsewhere appears to help progress the subject towards improved finger function [15]. Subjects made larger improvements in fractionation than speed or accuracy that were not shaped with an algorithm or reinforced with feedback. Similarly, subjects also failed to make improvements in peak finger extension, which was not reinforced with an algorithm, during Hammer Task training. These results are congruent with those of Lum et al. [37] who found that subjects with strokes, training using the MIME system, reduced force direction errors when this construct was shaped with an algorithm.

Day three training performance for the three proximal kinematic measures (hand deviation, path length and trajectory smoothness), deviates from the trend of daily incremental improvement during the rest of the trial (See Figure 3). Three subjects, all with chronic strokes had their worst performance on day three for these measures. This may be secondary to higher levels of fatigue associated with the initiation of an intense training protocol in these subjects. A comparable pattern of high levels of fatigue during the early days of a trial has been demonstrated by a group of CIMT subjects with chronic strokes [41].

Our overarching goal is to integrate development of robotic assisted training devices with the most effective training paradigm for recovery of hand function. It is therefore important to compare the changes in JTHF time in this current study to other studies performed in our lab. In a former study of comparable duration, that trained the hand only, the subjects showed a 10% improvement in the time of the JTHF [6], while in this current study that trained the arm and hand simultaneously, there was a 24 sec decrease in the time to complete the JTHF achieved by the subjects in this study, which was equal to a 20% change in the time needed to complete all the items on the JTHF. This decrease in time represents 27% of the difference between the initial scores of the stroke subjects, and the aged matched controls. Moreover, it represents 33% of the difference between the initials scores of the impaired and uninvolved hand. Given this robust improvement as well as the difference between initial scores for the impaired arm and the less impaired arm, one can suggest that functional changes may have occurred secondary to this training. Future analyses would be required to relate this robust change in the JTHF with changes in activities of daily living function.

Essential factors such as the dosage and intensity of the practice, the focus of attention on the movement outcome, and the drive provided by specific algorithms are important to achieving functional outcomes. However, these factors have been similar in our past studies. What was different in this study was the complexity of the movements required to interact with the virtual simulations. When we trained the hand alone, the gaming simulations were very simple activities, requiring only control of wrist and finger movement. Whereas in this study the activities required by the gaming simulations were more complex and required simultaneous control of integrated shoulder, elbow, forearm, wrist and finger movements. These factors appear to have had a substantial, positive effect on our goal of improving hemiparetic hand function.

However, an important question to consider is whether it is the complexity of the simulations or the consistent training of integrated shoulder, elbow, forearm, wrist and finger movements that is responsible for these improvements. This question engenders another possible training variation. Will the findings be as robust if the subjects train on complex activities that only require independent and discrete upper arm movements or hand movements. To answer this question our lab is in the process of initiating a randomized controlled trial testing for the effect of integrated versus isolated training of proximal and distal upper extremity effectors to compare the outcomes with our previous findings.


The quasi experimental data presented in this paper lacks the controls necessary to make conclusive statements about the efficacy of this treatment approach. However, double baseline measures indicated that the subjects in this study were neurologically stable. We believe that the magnitude of the changes and the stability of the patient's function prior to training, along with maintenance of several aspects of the gains demonstrated at retention make a compelling argument that this approach to training warrants continued study.


  1. Kwakkel G, Kollen BJ, van der Grond J, Prevo AJ: Probability of regaining dexterity in the flaccid upper limb: impact of severity of paresis and time since onset in acute stroke. Stroke 2003, 34: 2181-2186. 10.1161/01.STR.0000087172.16305.CD

    Article  PubMed  Google Scholar 

  2. Carey JR, Bhatt E, Nagpal A: Neuroplasticity promoted by task complexity. Exerc Sport Sci Rev 2005, 33: 24-31.

    PubMed  Google Scholar 

  3. Hlustik P, Solodkin A, Noll DC, Small SL: Cortical plasticity during three-week motor skill learning. J Clin Neurophysiol 2004, 21: 180-191. 10.1097/00004691-200405000-00006

    Article  PubMed  Google Scholar 

  4. Nudo RJ, Milliken GW: Reorganization of movement representations in primary motor cortex following focal ischemic infarcts in adult squirrel monkeys. J Neurophysiol 1996, 75: 2144-2149.

    CAS  PubMed  Google Scholar 

  5. Frost SB, Milliken GW, Plautz EJ, Masterton RB, Nudo RJ: Somatosensory and motor representations in cerebral cortex of a primitive mammal (Monodelphis domestica): a window into the early evolution of sensorimotor cortex. J Comp Neurol 2000, 421: 29-51. 10.1002/(SICI)1096-9861(20000522)421:1<29::AID-CNE3>3.0.CO;2-9

    Article  CAS  PubMed  Google Scholar 

  6. Merians AS, Poizner H, Boian R, Burdea G, Adamovich S: Sensorimotor training in a virtual reality environment: does it improve functional recovery poststroke? Neurorehabil Neural Repair 2006, 20: 252-267. 10.1177/1545968306286914

    Article  PubMed  Google Scholar 

  7. Merians AS, Tunik E, Fluet GG, Qiu Q, Adamovich SV: Innovative approaches to the rehabilitation of upper extremity hemiparesis using virtual environments. Eur J Phys Rehabil Med 2008.

    Google Scholar 

  8. Adamovich S, Qiu Q, Mathai A, Fluet G, Merians A: Recovery of hand function in virtual reality: training hemiparetic hand and arm together or separately. IEEE Engineering in Medicine and Biology Conference; Vancouver, Canada 2008, 3475-3478.

    Google Scholar 

  9. Krebs HI, Volpe BT, Ferraro M, Fasoli S, Palazzolo J, Rohrer B, Edelstein L, Hogan N: Robot-aided neurorehabilitation: from evidence-based to science-based rehabilitation. Top Stroke Rehabil 2002, 8: 54-70. 10.1310/6177-QDJJ-56DU-0NW0

    Article  CAS  PubMed  Google Scholar 

  10. Sanchez RJ, Liu J, Rao S, Shah P, Smith R, Rahman T, Cramer SC, Bobrow JE, Reinkensmeyer DJ: Automating arm movement training following severe stroke: functional exercises with quantitative feedback in a gravity-reduced environment. IEEE Trans Neural Syst Rehabil Eng 2006, 14: 378-389. 10.1109/TNSRE.2006.881553

    Article  PubMed  Google Scholar 

  11. Kahn LE, Lum PS, Rymer WZ, Reinkensmeyer DJ: Robot-assisted movement training for the stroke-impaired arm: Does it matter what the robot does? J Rehabil Res Dev 2006, 43: 619-630. 10.1682/JRRD.2005.03.0056

    Article  PubMed  Google Scholar 

  12. Lum PS, Burgar CG, Van der Loos M, Shor PC, Majmundar M, Yap R: MIME robotic device for upper-limb neurorehabilitation in subacute stroke subjects: A follow-up study. J Rehabil Res Dev 2006, 43: 631-642. 10.1682/JRRD.2005.02.0044

    Article  PubMed  Google Scholar 

  13. Hesse S, Schmidt H, Werner C, Bardeleben A: Upper and lower extremity robotic devices for rehabilitation and for studying motor control. Curr Opin Neurol 2003, 16: 705-710. 10.1097/00019052-200312000-00010

    Article  PubMed  Google Scholar 

  14. Adamovich SV, Fluet GG, Merians AS, Mathai A, Qiu Q: Incorporating haptic effects into three-dimensional virtual environments to train the hemiparetic upper extremity. IEEE Trans Neural Syst Rehabil Eng 2009, 17: 512-520.

    Article  PubMed Central  PubMed  Google Scholar 

  15. Adamovich SV, Fluet GG, Mathai A, Qiu Q, Lewis J, Merians AS: Design of a complex virtual reality simulation to train finger motion for persons with hemiparesis: a proof of concept study. J Neuroeng Rehabil 2009, 6: 28. 10.1186/1743-0003-6-28

    Article  PubMed Central  PubMed  Google Scholar 

  16. Merians AS, Tunik E, Adamovich SV: Virtual reality to maximize function for hand and arm rehabilitation: exploration of neural mechanisms. Stud Health Technol Inform 2009, 145: 109-125.

    PubMed Central  PubMed  Google Scholar 

  17. Gowland C, Stratford P, Ward M, Moreland J, Torresin W, Van Hullenaar S, Sanford J, Barreca S, Vanspall B, Plews N: Measuring physical impairment and disability with the Chedoke-McMaster Stroke Assessment. Stroke 1993, 24: 58-63.

    Article  CAS  PubMed  Google Scholar 

  18. Wolf SL, Catlin PA, Ellis M, Archer AL, Morgan B, Piacentino A: Assessing Wolf motor function test as outcome measure for research in patients after stroke. Stroke 2001, 32: 1635-1639.

    Article  CAS  PubMed  Google Scholar 

  19. Jebsen RH, Taylor N, Trieschmann RB, Trotter MJ, Howard LA: An objective and standardized test of hand function. Arch Phys Med Rehabil 1969, 50: 311-319.

    CAS  PubMed  Google Scholar 

  20. Charles JR, Wolf SL, Schneider JA, Gordon AM: Efficacy of a child-friendly form of constraint-induced movement therapy in hemiplegic cerebral palsy: a randomized control trial. Dev Med Child Neurol 2006, 48: 635-642. 10.1017/S0012162206001356

    Article  PubMed  Google Scholar 

  21. Conforto AB, Ferreiro KN, Tomasi C, dos Santos RL, Moreira VL, Marie SK, Baltieri SC, Scaff M, Cohen LG: Effects of somatosensory stimulation on motor function after subacute stroke. Neurorehabil Neural Repair 24: 263-272.

  22. Qiu Q, Fluet GG, Lafond I, Merians AS, Adamovich SV: Coordination changes demonstrated by subjects with hemiparesis performing hand-arm training using the NJIT-RAVR robotically assisted virtual rehabilitation system. Conf Proc IEEE Eng Med Biol Soc 2009, 1: 1143-1146.

    PubMed Central  Google Scholar 

  23. Rohrer B, Fasoli S, Krebs HI, Volpe B, Frontera WR, Stein J, Hogan N: Submovements grow larger, fewer, and more blended during stroke recovery. Motor Control 2004, 8: 472-483.

    PubMed  Google Scholar 

  24. Adamovich S, Merians A, Boian R, Tremaine M, Burdea G, Recce M, Poizner H: A virtual reality (VR)-based exercise system for hand rehabilitation post stroke. Presence 2005, 14: 161-174. 10.1162/1054746053966996

    Article  Google Scholar 

  25. Krakauer JW: Motor learning: its relevance to stroke recovery and neurorehabilitation. Curr Opin Neurol 2006, 19: 84-90. 10.1097/

    Article  PubMed  Google Scholar 

  26. Lang CE, Beebe JA: Relating movement control at 9 upper extremity segments to loss of hand function in people with chronic hemiparesis. Neurorehabil Neural Repair 2007, 21: 279-291. 10.1177/1545968306296964

    Article  PubMed  Google Scholar 

  27. Lin KC, Hsieh YW, Wu CY, Chen CL, Jang Y, Liu JS: Minimal detectable change and clinically important difference of the Wolf Motor Function Test in stroke patients. Neurorehabil Neural Repair 2009, 23: 429-434. 10.1177/1545968308331144

    Article  CAS  PubMed  Google Scholar 

  28. Wolf SL, Winstein CJ, Miller JP, Taub E, Uswatte G, Morris D, Giuliani C, Light KE, Nichols-Larsen D: Effect of constraint-induced movement therapy on upper extremity function 3 to 9 months after stroke: the EXCITE randomized clinical trial. Jama 2006, 296: 2095-2104. 10.1001/jama.296.17.2095

    Article  CAS  PubMed  Google Scholar 

  29. Kwakkel G: Impact of intensity of practice after stroke: issues for consideration. Disabil Rehabil 2006, 28: 823-830. 10.1080/09638280500534861

    Article  PubMed  Google Scholar 

  30. Kwakkel G, Kollen BJ, Krebs HI: Effects of robot-assisted therapy on upper limb recovery after stroke: a systematic review. Neurorehabil Neural Repair 2008, 22: 111-121.

    Article  PubMed Central  PubMed  Google Scholar 

  31. Mehrholz J, Platz T, Kugler J, Pohl M: Electromechanical and Robot-Assisted Arm Training for Improving Arm Function and Activities of Daily Living After Stroke. Stroke 2009.

    Google Scholar 

  32. Aisen ML, Krebs HI, Hogan N, McDowell F, Volpe BT: The effect of robot-assisted therapy and rehabilitative training on motor recovery following stroke. Arch Neurol 1997, 54: 443-446.

    Article  CAS  PubMed  Google Scholar 

  33. Ferraro M, Palazzolo JJ, Krol J, Krebs HI, Hogan N, Volpe BT: Robot-aided sensorimotor arm training improves outcome in patients with chronic stroke. Neurology 2003, 61: 1604-1607.

    Article  CAS  PubMed  Google Scholar 

  34. Dipietro L, Krebs HI, Fasoli SE, Volpe BT, Hogan N: Submovement changes characterize generalization of motor recovery after stroke. Cortex 2008.

    Google Scholar 

  35. Lang CE, MacDonald JR, Gnip C: Counting repetitions: an observational study of outpatient therapy for people with hemiparesis post-stroke. J Neurol Phys Ther 2007, 31: 3-10.

    Article  PubMed  Google Scholar 

  36. Daly JJ, Hogan N, Perepezko EM, Krebs HI, Rogers JM, Goyal KS, Dohring ME, Fredrickson E, Nethery J, Ruff RL: Response to upper-limb robotics and functional neuromuscular stimulation following stroke. J Rehabil Res Dev 2005, 42: 723-736. 10.1682/JRRD.2005.02.0048

    Article  PubMed  Google Scholar 

  37. Lum PS, Burgar CG, Shor PC: Evidence for improved muscle activation patterns after retraining of reaching movements with the MIME robotic system in subjects with post-stroke hemiparesis. IEEE Trans Neural Syst Rehabil Eng 2004, 12: 186-194. 10.1109/TNSRE.2004.827225

    Article  PubMed  Google Scholar 

  38. Fasoli SE, Krebs HI, Stein J, Frontera WR, Hogan N: Effects of robotic therapy on motor impairment and recovery in chronic stroke. Arch Phys Med Rehabil 2003, 84: 477-482. 10.1053/apmr.2003.50110

    Article  PubMed  Google Scholar 

  39. Wulf G, McNevin NH, Fuchs T, Ritter F, Toole T: Attentional focus in complex skill learning. Res Q Exerc Sport 2000, 71: 229-239.

    Article  CAS  PubMed  Google Scholar 

  40. Wulf G, Landers M, Lewthwaite R, Tollner T: External focus instructions reduce postural instability in individuals with Parkinson disease. Phys Ther 2009, 89: 162-168. 10.2522/ptj.20080045

    Article  PubMed  Google Scholar 

  41. Underwood J, Clark PC, Blanton S, Aycock DM, Wolf SL: Pain, fatigue, and intensity of practice in people with stroke who are receiving constraint-induced movement therapy. Phys Ther 2006, 86: 1241-1250. 10.2522/ptj.20050357

    Article  PubMed  Google Scholar 

Download references


We would like to acknowledge Anita Van Wingerden, PT for her assistance in testing the subjects. This work was supported in part by NIH grant HD58301 and by the National Institute on Disability and Rehabilitation Research, Rehabilitation Engineering Research Center Grant # H133E050011.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Alma S Merians.

Additional information

Competing interests

The authors declare no competing interests with respect to the authorship and/or publication of this article.

Authors' contributions

All authors read and approved the final manuscript. ASM participated in the robotic/VR system design, study design, data collection, data analysis, initial manuscript preparation and manuscript revision. GGF participated in the study design, subject recruitment, data collection, data analysis, initial manuscript preparation and manuscript revision. QQ participated in the robotic/VR system design, data collection, data analysis and initial manuscript preparation. SS participated in the data collection, manuscript preparation and manuscript revision processes. IL participated in the data collection, manuscript preparation and manuscript revision processes. AD participated in the study design, data analysis and manuscript revision processes. SVA participated in the robotic/VR system design, study design, data collection, data analysis, initial manuscript preparation and manuscript revision processes.

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Merians, A.S., Fluet, G.G., Qiu, Q. et al. Robotically facilitated virtual rehabilitation of arm transport integrated with finger movement in persons with hemiparesis. J NeuroEngineering Rehabil 8, 27 (2011).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: