- Open Access
Can kinematic parameters of 3D reach-to-target movements be used as a proxy for clinical outcome measures in chronic stroke rehabilitation? An exploratory study
Journal of NeuroEngineering and Rehabilitation volume 17, Article number: 106 (2020)
Despite numerous trials investigating robot-assisted therapy (RT) effects on upper-extremity (UE) function after stroke, few have explored the relationship between three-dimensional (3D) reach-to-target kinematics and clinical outcomes. The objectives of this study were to 1) investigate the correlation between kinematic parameters of 3D reach-to-target movements and UE clinical outcome measures, and 2) examine the degree to which differences in kinematic parameters across individuals can account for differences in clinical outcomes in response to RT.
Ten chronic stroke survivors participated in a pilot RT intervention (eighteen 1-h sessions) integrating cognitive skills training and a home-action program. Clinical outcome measures and kinematic parameters of 3D reach-to-target movements were collected pre- and post-intervention. The correlation between clinical outcomes and kinematic parameters was investigated both cross-sectionally and longitudinally (i.e., changes in response to the intervention). Changes in clinical outcomes and kinematic parameters were tested for significance in both group and subject-by-subject analyses. Potential associations between individual differences in kinematic parameters and differences in clinical outcomes were examined.
Moderate-to-strong correlation was found between clinical measures and specific kinematic parameters when examined cross-sectionally. Weaker correlation coefficients were found longitudinally. Group analyses revealed significant changes in clinical outcome measures in response to the intervention; no significant group changes were observed in kinematic parameters. Subject-by-subject analyses revealed changes with moderate-to-large effect size in the kinematics of 3D reach-to-target movements pre- vs. post-intervention. Changes in clinical outcomes and kinematic parameters varied widely across participants.
Large variability was observed across subjects in response to the intervention. The correlation between changes in kinematic parameters and clinical outcomes in response to the intervention was variable and not strong across parameters, suggesting no consistent change in UE motor strategies across participants. These results highlight the need to investigate the response to interventions at the individual level. This would enable the identification of clusters of individuals with common patterns of change in response to an intervention, providing an opportunity to use cluster-specific kinematic parameters as a proxy of clinical outcomes.
ClinicalTrials.gov, NCT02747433. Registered on April 21st, 2016
Every year, about 795,000 people suffer a new or recurrent stroke in the United States  leading to hemiparesis and significant effects on the functional use of the paretic arm and hand . Despite treatment, upper-extremity (UE) motor impairments and limited abilities to reach for and manipulate objects persist . Less than half of the individuals who experience a stroke and severe UE hemiparesis in the acute phase regain purposeful UE function after 6 months [4, 5].
A large body of literature based on motor learning theories has shown that high-intensity, high-dosage rehabilitation interventions can facilitate sensorimotor recovery in stroke survivors [6,7,8,9]. Guidelines  recommend that the response to rehabilitation interventions be assessed across domains of the International Classification of Functioning, Disability and Health (ICF) . Accordingly, clinical research studies report the results of rehabilitation interventions via a collection of standardized clinical outcome measures of UE function (e.g., Fugl-Meyer Assessment Upper Extremity subscale [FMA-UE] , Wolf Motor Function Test [WMFT] and Functional Ability Scale [WMFT-FAS] [13, 14]), and measures of UE activity performance in the home (e.g., Motor Activity Log [MAL] ).
Researchers and clinicians have investigated the use of kinematic parameters of UE movements as a proxy for clinical outcome measures after stroke [16,17,18]. This interest has been motivated by the development of rehabilitation technologies (e.g., robotic training devices and wearable sensing technologies) to collect data during the performance of UE movements and the need for precise and valid measures of UE motor function. While many researchers have used kinematic parameters to study two-dimensional (2D) UE reaching movements, few have studied the kinematics of three-dimensional (3D) movements [19,20,21].
Kinematic parameters derived via tracking of 2D arm reaching movements moderately correlated with FMA-UE scores, WMFT and WMFT-FAS scores, and self-reports of the amount of use (MAL-AOU) and quality of movement (MAL-QOM) of the hemiparetic limb [19,20,21]. Moderate correlation was also shown between clinical scores and kinematic parameters of UE movements performed using a rehabilitation robot. Seminal work by Rohrer et al.  showed that improvements in robot-based kinematic parameters aimed to capture the smoothness of arm reaching movements moderately correlated with changes in FMA-UE scores in response to robot-assisted intervention. Colombo et al. [23,24,25] further demonstrated a moderate correlation between robot-based kinematic parameters and FMA-UE scores; work by Zollo et al. , Otaka et al. , Duret et al. [28, 29], and Pila et al.  made comparable observations. Other authors achieved similar results by collecting kinematic data during the performance of tasks consisting of drawing geometric figures of different shapes [31, 32], tracing large semicircular arcs to measure UE active range of motion , or deriving kinematic parameters from distal movements (e.g., wrist and finger movements) . Larger correlations were shown by Krebs et al.  when implementing more complex analytical models than those utilized in previous work. Interestingly, despite the moderate correlation coefficients between clinical scores and kinematic parameters at the group level, studies reporting data on a subject-by-subject basis showed a significant variability across individuals [22, 23, 28].
Because they are more relevant from a functional point of view than 2D movements, several authors have focused their efforts on the analysis of 3D movements and the associations between their kinematic parameters and clinical outcome measures. Seminal work by Cirstea  showed a strong correlation between joint kinematics of 3D arm-reaching movements and FMA-UE scores. However, these results are in conflict with later studies showing moderate-to-poor associations between 3D arm-reaching kinematics and FMA-UE scores [37,38,39]. Other research of UE kinematics during the performance of simulated drinking from a glass [40,41,42,43,44] also reported moderate-to-poor correlations with clinical outcome measures of motor impairment and activity performance. Subject-by-subject kinematic analyses are not typically reported for 3D arm-reaching movements and are needed to examine individual differences that contribute to these low associations. Specifically, individual analyses may reveal the degree to which changes in UE activity performance may be attributed to the restitution of motor function or use of compensatory movement strategies after stroke. Additionally, little is known about the association between changes in the kinematic parameters and changes in the clinical outcome measures observed in response to the intervention.
To that end, we analyzed pilot data collected during 3D reach-to-target movements in chronic stroke survivors who received a novel robot-assisted therapy protocol to 1) investigate the correlation between kinematic parameters of three-dimensional (3D) reach-to-target movements and UE clinical outcome measures, both cross-sectionally and longitudinally, and 2) examine the degree to which differences in kinematic parameters across individuals can account for differences in clinical outcomes in response to RT.
The study was approved by Partners Healthcare Institutional Review Board and registered on ClinicalTrials.gov (NCT02747433). All participants provided written informed consent according to the Declaration of Helsinki.
Ten chronic stroke survivors participated in the study . The study inclusion criteria were: 1) chronic unilateral stroke (> 6 months); 2) moderate UE hemiparesis (baseline FMA-UE score between 21 and 50 out of 66 points) ; and 3) cognitive function adequate to understand and actively engage in the research procedures (Montreal Cognitive Assessment Score ≥ 26) . The exclusion criteria were: 1) more than moderate impairments in paretic UE sensation, passive range of motion, and pain; 2) considerable muscle tone (Modified Ashworth Scale ≥3) ; 3) hemispatial neglect or visual field loss; 4) aphasia limiting comprehension and completion of the treatment protocol; 5) concomitant UE therapy; and 6) contraindications to RT. Table 1 shows the baseline characteristics of the study participants.
Study volunteers participated in the Active Learning Program for Stroke (ALPS) in which one-on-one sessions with an occupational therapist consisted of cognitive strategy training and individualized home programs aimed to facilitate the transfer of robot-trained UE movements to functional use of the paretic arm and hand during everyday tasks. In this development of concept study, the repetitive movement therapy was delivered using two commercially available devices: the ArmeoSpring® (Hocoma AG, Volketswil, Switzerland) and the Amadeo® (Tyromotion, Graz, Austria). All participants received 18 one-hour sessions of therapy over a period of 6–7 weeks. Additional details concerning the intervention are reported elsewhere .
Clinical outcome measures
Subjects were assessed at baseline and at the end of the intervention using clinical outcome measures across domains of the International Classification of Functioning, Disability and Health (ICF) . A single rater, blinded to the group assignment, performed all assessments. UE motor function was assessed via observation using the Fugl-Meyer UE Assessment (FMA-UE) . The Wolf Motor Function Test (WMFT) was used to assess activity limitations of the paretic arm and the quality of movement, as rated using the Functional Ability Scale (WMFT-FAS) [13, 14] . The Motor Activity Log was used to collect information about self-perceived amount of use (MAL-AOU) and quality of movement (MAL-QOM) of the paretic UE during daily activities .
Kinematics of reach-to-target movements
A 10-camera motion capture system (Vicon, Oxford Metrics Ltd., Oxford, UK) was used to track reflective markers placed on the upper body during reach-to-target movements (Fig. 1). The data was recorded at a rate of 120 frames per second.
The subjects were seated on a bench without back support so as not to constrain movement and faced a vertical panel (Fig. 1a). The panel had twelve numbered targets positioned in a clock-like fashion 20 cm from its center, which was aligned with the acromion of the arm being tested. To determine the position of the targets in the 3D calibrated volume of the motion capture system, four reflective markers were placed on the back of the panel. The distance between the subject and the center of the panel was set according to each subject’s arm length measured with the fist closed. To standardize the starting position of the reaching-to-target movements, an additional target was positioned at forearm distance (measured from the lateral epicondyle to the ulnar styloid process) from the center of the panel along the virtual line connecting the center of the panel and the shoulder acromion.
During each trial, study participants were instructed to reach at a self-selected speed to specific numbers on the panel. Each movement was performed with a closed fist from the starting position to the selected target and then back to the starting position. The target order was randomized, and the same sequence was used across sessions. Subjects were allowed to rest as needed. The data analyses described in the following were based on 36 reach-to-target movements performed with the paretic UE and 36 reach-to-target movements performed with non-paretic UE by each subject.
The Nexus 2.8.1 software (Vicon, Oxford Metrics Ltd., Oxford, UK) was used to derive the movement kinematics from the position data of the UE reflective markers. The start and end of the reach-to-target movements were identified using the marker positioned on the metacarpal head of the index finger; events were manually verified. Joint angles were estimated using the Nexus 2.8.1 software via a standard biomechanical model in which anatomical joints are represented as universal joints.
The data was then imported to MATLAB (The MathWorks Inc., Natick MA, USA) and custom scripts were used to derive the eleven kinematic parameters listed in Table 2. These kinematic parameters were selected based on recent recommendations to enhance standardization of UE kinematic studies in stroke survivors .
The marker positioned on the metacarpal head of the index finger was also used to derive the following six parameters. The trajectory directness  and the movement time duration were computed to capture movement accuracy and efficiency. The time to peak velocity and the peak velocity provided information on movement planning and speed, respectively. Movement smoothness was quantified by computing the total number of velocity peaks  and the log dimensionless jerk  of the marker trajectory. Finally, a subset of markers positioned on the UE and trunk was used to estimate shoulder and elbow range of motion. Compensatory trunk movements were captured by estimating the displacement of the trunk in the transverse and sagittal plane.
Spearman rank tests were used to assess correlations between the kinematic variables and clinical outcome measures. These analyses were performed both cross-sectionally and longitudinally. Cross-sectional analyses (i.e. pre- and post-intervention assessments) examined whether kinematic parameters were correlated with the severity of motor impairments and functional limitations captured by the clinical outcome measures. Longitudinal analyses (i.e. pre- vs. post-intervention assessments) were performed to determine if the changes in the kinematic parameters and clinical outcome measures following the intervention were correlated. These correlation tests were carried out both for total clinical scores (i.e., using all items of the scales) and for scores associated with the assessment of proximal body segments (i.e., using only items to assess shoulder and elbow), as the evaluated kinematics did not measure specific movements of distal body segments (e.g., forearm pro/supination, wrist and hand motions). Correlation coefficients were labeled as high (0.70 to 1.00), moderate (0.50 to 0.70), low (0.30 to 0.50) or negligible (0.00 to 0.30), according to the “rule of thumb” proposed by Hinkle et al. .
Paired t-tests were performed at the group level to determine if the clinical outcome measures and kinematic parameters collected during the study significantly changed in response to the intervention. Because of the small sample size, we used bootstrapping with 1000 samples and percentile-corrected confidence intervals for these analyses.
In addition, subject-by-subject analyses were performed for both the kinematic parameters and clinical outcome measures to examine changes occurring at the individual level using paired t-tests with bootstrapping. Cohen’s d effect size values were calculated for each comparison using the pre-intervention standard deviation as the denominator in the calculation of Cohen’s d. We used Cohen’s conventions of d = 0.20, 0.50, and 0.80, representing small, medium, and large effect sizes, respectively . Clinical outcome measures were also examined at the individual level. Minimal clinically important difference (MCID) values were identified from the literature [52,53,54].
Statistical tests were performed using SPSS (Statistical Packages for Social Sciences, version 26.0; SPSS Inc., Chicago, IL, USA). Significance was set a priori at α = 0.05 and p-values were adjusted for multiple comparisons using a Holm correction . In the interpretation of the results, the emphasis will be on effect sizes due to the exploratory nature of the study and the small sample size.
Both cross-sectional and longitudinal correlation analyses examined associations between kinematic parameters and clinical outcome scores. Table 3 summarizes the results of these analyses.
The upper panel (A) of Table 3 shows the results of cross-sectional correlation tests. Low to moderate correlation coefficients (rs < 0.70) were observed for the majority of the comparisons. Although statistically significant associations were identified between many kinematic parameters and clinical outcome measures, high correlation coefficients (rs > 0.70) were only found between elbow flexion-extension, thorax rotation, and torso excursion and a clinical measure of UE impairment (FMA-UE).
The lower panel (B) of Table 3 shows the results of the correlation analyses for the longitudinal data (i.e. correlation between changes in kinematic parameters and changes in clinical outcome measures in response to the intervention). Low and non-significant correlation coefficients (rs < 0.50) were found between the changes in the kinematic parameters and clinical outcome measures following the intervention, except for a negative moderate association between the FMA-UE and shoulder flexion-extension.
Paired t-tests revealed significantly improved motor function with a large and medium-to-large effect size for all clinical outcome measures, except for the performance time (WMFT-Time) which displayed a small effect size (Table 4). Detailed analyses of the clinical outcomes have been reported elsewhere .
Paired t-test analyses did not show any significant changes in kinematic parameters pre- to post-intervention. Also, the effect size for most of the kinematic parameters was small. Only the time to peak velocity (T%Vmax) was marked by a medium-to-large effect size and the change in log dimensionless jerk (LDJ) was marked by a small-to-medium effect (Table 5). These findings suggest that, at the group level, subjects did not change consistently their movement strategies (as measured by kinematics) during 3D reach-to-target movements in response to the intervention.
In attempt to investigate why changes in response to the intervention were clearly identified in the analysis of the clinical outcome measures whereas no consistent changes were shown by the kinematic parameters of UE movements, clinical outcome measures and kinematic parameters were examined and compared on a subject-by-subject basis.
Figure 2 provides a graphical representation of results of the paired t-tests performed at the individual level, using data collected for all targets pre- vs. post-intervention. Statistically significant improvements were observed most frequently across study participants for the time to peak velocity (T%Vmax) and torso excursion (TExc) as seen in Fig 2 (speed and planning and trunk movement panels, respectively). The large effect size estimates associated with these parameters shown in Table 6 suggest that the intervention was effective in facilitating the planning and execution of reach-to-target movements and improving the isolation of trunk and UE motions during reach on an individual basis. The other kinematic parameters significantly changed following intervention in less than half of the participants. Figure 2 and Table 6 illustrate the high degree of variability among participants. This high variability likely contributed to the small kinematic changes evidenced at the group level.
At the individual level, all subjects displayed changes in kinematic parameters, some of which exhibited medium to large effect size. The first row of data in Table 6 provides group kinematic data for the non-paretic UE, to be used as a reference. When examining the data on a subject-by-subject basis (i.e., the individual rows of Table 6), it is apparent that the mean values (pre- and post-intervention) of several kinematic parameters for the paretic UE fell within the interval defined by the mean ± one standard deviation of the same kinematic parameter for the non-paretic UE. When changes pre- vs post-intervention in the kinematic parameter values for the paretic UE fell within such interval, they were not considered as noteworthy because of their similarity with the values measured during non-paretic reach-to-target movements. Furthermore, some of the statistically significant kinematic changes reported in Table 6 are small in magnitude and hence unlikely to be clinically important. We highlighted these cases in Table 6 (hatched cells of the table).
Examination of subject-by-subject changes in clinical outcome measures collected during the study also showed remarkably different responses to the intervention across individuals. Table 7 provides a summary of these data. It is worth noting that 9 out of 10 participants demonstrated clinically meaningful gains in response to the intervention, as indicated by the MCIDs for these outcome measures, and represented across ICF domains.
This pilot study examined changes in kinematic parameters of 3D reach-to-target movements in response to an intervention that combined cognitive strategy training and individualized home programs to facilitate the transfer of robot-trained UE movements to functional use of the paretic arm and hand during everyday tasks. Two fundamental questions were addressed via group and subject-by-subject analyses: 1) What are the associations between the kinematic parameters of 3D reach-to-target movements and UE clinical outcome measures? and 2) Can differences in kinematic parameters across individuals account for differences in clinical outcomes in response to RT?
The kinematic analysis methods utilized in this pilot study provide the methodology to explore group and individual differences in response to interventions and to identify kinematic parameters that may be used as a proxy for clinical outcome measures. These methods may be used in a future larger clinical trial aimed to further differentiate the key treatment elements (e.g. dose, cognitive strategy training, protocol adherence) and personal characteristics (e.g. time post stroke, impairment level) associated with the recovery of motor function after stroke. The low to moderate correlation between individual kinematic parameters of 3D movements and clinical scores observed in this pilot study may be attributed to the three factors discussed below.
Variability in response to the intervention
High variability in the response to UE intervention among these chronic stroke survivors likely contributed to the lack of statistically significant correlation as well as unexpected associations between clinical outcome measures and kinematic parameters at the group level. For instance, Table 3 shows a negative correlation between changes in shoulder flexion/extension range of motion and changes in FMA-UE scores in response to the intervention. This is counteractive from a clinical point of view. However, Fig. 2 and Table 6 highlight the fact that half of the study participants displayed a decrease and half an increase in shoulder flexion/extension range of motion pre- vs. post-intervention. Furthermore, Tables 6 and 7 show that the three subjects who displayed the largest decrease in shoulder flexion/extension range of motion (i.e., subjects 3, 6 and 10) are the same subjects who displayed the largest improvements in FMA-UE scores. This suggests that the distinct response observed in subjects 3, 6 and 10 and the small sample size of the study may be largely responsible for the negative correlation between changes in shoulder flexion/extension range of motion and changes in FMA-UE scores reported in Table 3. Figure 2 and Table 6 show that this correlation does not apply to the entire group.
Furthermore, by examining Fig. 2 and Table 6, one can identify additional subgroups of study participants displaying other common kinematic behaviors. For instance, none of the subjects displaying a change in torso excursion marked by large effect size showed an improvement in shoulder flexion/extension range of motion. Vice versa, subjects displaying an improvement in shoulder flexion/extension range of motion did not appear to rely on improving the control of torso excursion as part of their response to the intervention. These observations suggest the possibility that kinematic analyses may enable the identification of different motor strategies in response to the intervention (e.g., some subjects relying on improving the control of torso excursion vs. other subjects increasing shoulder flexion/extension range of motion). The results also suggest that different motor strategies might be adopted by individuals with different baseline motor impairments.
Importantly, these results highlight the shortcomings of group analyses as the ones reported in Table 3 when the results are marked by high variability in the kinematic and clinical response to the intervention. The subject-by-subject analyses presented in this manuscript are a departure from previous studies focused on group analyses [36,37,38,39,40,41,42,43,44] that we carried out in order to address the above-discussed shortcomings. We highlighted distinct changes in movement characteristics across individuals in response to the intervention. It is conceivable that a larger study, aimed to investigate variability across individuals, would enable the identification of clusters of participants with similar patterns of kinematic parameters during UE reaching tasks and similar changes in response to the intervention. These clusters would display higher levels of association between specific kinematic parameters and clinical outcome measures.
Changes in motor strategy may be limited by the intervention dosage
Although statistically and clinically significant improvements were apparent on clinical outcome measures after only 18 sessions of therapy (Tables 4 and 7), consistent changes in motor strategy were not evident in the individual analyses of kinematic data (Table 6). The lack of consistent relationships observed between these two types of measures for participants with chronic stroke impairments, even at the individual level, suggests that kinematics may be a better indicator of “true” motor recovery and may distinguish between motor restitution and the use of dormant capacities or compensatory strategies that contribute to changes in clinical outcome measures. In fact, much of the current literature in the chronic stroke population fails to report results identifying “true” motor restitution as distinct from the unmasking of latent capacity, as studies often rely solely on clinical outcome measures to assess intervention effectiveness.
Would interventions marked by a higher-dosage and delivered over a longer time period have resulted in greater changes in motor strategies reflected in the kinematic parameters of arm reaching movements? While high dosage UE intervention studies after stroke [56, 57] may provide greater opportunities to improve motor function, as evidenced by clinical measures of performance, these high-dose studies have yet to be evaluated with kinematic analyses of UE task performance. Distinct patterns of changes in both clinical measures of performance and kinematic parameters could reflect “true” changes in UE motor strategy following intervention. In contrast, modest improvements in clinical measures of performance that are not accompanied by distinct changes in kinematic parameters may be more likely related to the unmasking of capabilities that were quiescent at the beginning of the intervention, or to the use of compensatory strategies [57, 58]. In this context, it would be interesting to compare results in chronic stroke survivors with results in a more acute population, which has the potential to display motor gains of greater magnitude and possibly clearer changes in motor strategy.
A single task or kinematic parameter carries limited information
The kinematic parameters reported in this study were derived from a single 3D reach-to-target motor task, whereas clinical outcome assessments typically measure the functional use of the paretic arm and hand during a variety of movement tasks. This may contribute to a mismatch between the changes in motor abilities indicated by clinical outcome assessments and those that are kinematically derived from a single motor task. For instance, the kinematics of reach-to-target movements primarily measure the control of proximal body segments. In contrast, changes in the clinical outcome measures employed in the study also reflect changes in the control of distal body segments (i.e. manipulation tasks), which were not investigated by our kinematic analysis. Recent recommendations highlight the need for utilizing a battery of five motor tasks to assess changes observed in movement kinematics during clinical trials with a focus on sensorimotor recovery in stroke survivors . Additionally, recent studies showing that wearable sensor data collected during functional tasks can accurately estimate clinical scores suggest that kinematic data collected across a variety of motor tasks may better serve as a proxy for estimating and tracking clinical outcome measures in future trials [59,60,61].
Limitations and future studies
The results of this pilot study provide motivation to further explore the mechanisms of recovery during rehabilitation interventions in chronic stroke survivors. The small number of participants did not allow us the use of more complex statistical analyses and did not enable the identification of clusters of individuals who responded consistently to clinical interventions. In larger studies, analyses could be carried out separately for each cluster or at the group level using more complex regression models to examine possible relationships among the variables, which may be or not be linear. These models could include factors that may contribute to the relationship between kinematic variables and clinical outcomes, such as age, handedness, stroke lesion and chronicity. Larger studies would also allow for the kinematic investigation of 3D reach-to-target movements on a target-by-target basis (see plots in Supplementary Materials), further contributing to our understanding of motor recovery. Although these plots do not suggest obvious trends across targets, one would expect the identification of different clusters of motor performance (which may be associated with motor phenotypes) based on kinematic characteristics for individual targets. For example, reaching for ipsilateral targets with the paretic arm requires the inhibition of pathological flexor synergies; reaching for contralateral targets is facilitated by extensor synergies; and reaching for targets around the midline requires the modulation of both flexor and extensor synergies.
Further investigation of UE kinematics across an array of motor tasks that better reflect important clinical changes in the control of movement may contribute to greater understanding of motor function recovery. The use of standard sets of tasks and kinematic parameters to test motor capacity across studies will allow for better comparison across studies and a means to aggregate kinematic data for meta-analytic reviews [16, 58]. The development of wearable sensors to quantitatively evaluate UE movements where they matter the most, in the home-setting, has the potential to better measure UE function and limitations during activities of daily living. This would provide a more comprehensive evaluation of UE performance after stroke and a better characterization of the mechanisms underlying changes observed in clinical outcome measures.
The results of this development-of-concept study showed large variability in the response to rehabilitation in a small sample of individuals with chronic motor impairments after stroke. Although statistically significant correlations were identified between kinematic parameters and clinical outcomes, correlation coefficients were not high. The high variability across kinematic parameters suggests no consistent pattern of change in UE motor strategies across participants. It is unclear if interventions marked by larger motor gains would display a more consistent change in kinematic behaviors. Nonetheless, our results support the need to further investigate the impact of interventions at the individual level. This would enable the identification of clusters of individuals with common patterns of change in kinematic parameters in response to an intervention, providing an opportunity to use cluster-specific kinematic parameters as a proxy of clinical outcomes.
Availability of data and materials
The dataset used in this manuscript is available upon request to be submitted to the corresponding author. The authors intend to post the dataset on PhysioNet https://physionet.org/.
Active Learning Program for Stroke
Range of Elbow Flexion-Extension
Fugl-Meyer Upper Extremity Assessment
International Classification of Functioning, Disability and Health
Motor Activity Log
Log Dimensionless Jerk
Number of Velocity Peaks
Range of Shoulder Abduction-Adduction
Range of Shoulder Flexion-Extension
- T%Vmax :
Time to Peak Velocity
- Vmax :
Wolf Motor Function Test
Wolf Motor Function Test Functional Ability Scale
Benjamin EJ, Muntner P, Alonso A, Bittencourt MS, Callaway CW, Carson AP, et al. Heart disease and stroke statistics—2019 update: a report from the American Heart Association. Circulation. 2019;139:10.
Jørgensen HS, Nakayama H, Raaschou HO, Vive-Larsen J, Støier M, Olsen TS. Outcome and time course of recovery in stroke. Part II: time course of recovery. The Copenhagen stroke study. Arch Phys Med Rehabil. 1995;76(5):406–12.
Tretriluxana J, Gordon J, Fisher BE, Winstein CJ. Hemisphere specific impairments in reach-to-grasp control after stroke: effects of object size. Neurorehabil Neural Repair. 2009;23(7):679–91.
Langhorne P, Coupar F, Pollock A. Motor recovery after stroke: a systematic review. Lancet Neurol. 2009;8(8):741–54 Available from: https://linkinghub.elsevier.com/retrieve/pii/S1474442209701504.
Warlow C, Van Gijn J, Dennis MS, Wardlaw JM, Sandercock PAG, Rinkel G, et al. Stroke: practical management; 2008.
French B, Thomas LH, Leathley MJ, Sutton CJ, McAdam J, Forster A, et al. Repetitive task training for improving functional ability after stroke. Cochrane Database Syst Rev. 2007 Oct;4:CD006073.
Birkenmeier RL, Prager EM, Lang CE. Translating animal doses of task-specific training to people with chronic stroke in 1-hour therapy sessions: a proof-of-concept study. Neurorehabil Neural Repair. 2010;24(7):620.
Kleim JA, Jones TA. Principles of experience-dependent neural plasticity: implications for rehabilitation after brain damage. J Speech Lang Hear Res. 2008;51(1):S225–39.
Lang CE, Strube MJ, Bland MD, Waddell KJ, Cherry-Allen KM, Nudo RJ, et al. Dose response of task-specific upper limb training in people at least 6 months poststroke: a phase II, single-blind, randomized, controlled trial. Ann Neurol. 2016;80(3):342–54.
Burridge J, Alt Murphy M, Buurke J, Feys P, Keller T, Klamroth-Marganska V, et al. A systematic review of international clinical guidelines for rehabilitation of people with neurological conditions: what recommendations are made for upper limb assessment? Front Neurol. 2019;10:567.
World Health Organization. International classification of functioning, disability and health (ICF). Geneva; 2001.
Fugl-Meyer AR, Jääskö L, Leyman I, Olsson S, Steglind S. The post-stroke hemiplegic patient. 1. A method for evaluation of physical performance. Scand J Rehabil Med. 1975;7(1):13–31 Available from: http://www.ncbi.nlm.nih.gov/pubmed/1135616.
Wolf SL, Catlin PA, Ellis M, Archer AL, Morgan B, Piacentino A. Assessing Wolf motor function test as outcome measure for research in patients after stroke. Stroke. 2001;32(7):1635–9 Available from: http://www.ncbi.nlm.nih.gov/pubmed/11441212.
Hodics TM, Nakatsuka K, Upreti B, Alex A, Smith PS, Pezzullo JC. Wolf Motor function test for characterizing moderate to severe hemiparesis in stroke patients. Arch Phys Med Rehabil. 2012;93(11):1963–7 Available from: http://www.ncbi.nlm.nih.gov/pubmed/22579647.
Uswatte G, Taub E, Morris D, Light K, Thompson PA. The motor activity Log-28: assessing daily use of the hemiparetic arm after stroke. Neurology. 2006;67(7):1189–94 Available from: http://www.ncbi.nlm.nih.gov/pubmed/17030751.
Schwarz A, Kanzler CM, Lambercy O, Luft AR, Veerbeek JM. Systematic review on kinematic assessments of upper limb movements after stroke. Stroke. 2019;50(3):718–27.
Alt Murphy M, Häger CK. Kinematic analysis of the upper extremity after stroke–how far have we reached and what have we grasped? Phys Ther Rev. 2015;20(3):137–55.
de los Reyes-Guzmán A, Dimbwadyo-Terrer I, Trincado-Alonso F, Monasterio-Huelin F, Torricelli D, Gil-Agudo A. Quantitative assessment based on kinematic measures of functional impairments during upper extremity movements: A review. Clin Biomech [Internet]. 2014;29(7):719–727. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0268003314001454.
Massie CL, Fritz S, Malcolm MP. Elbow extension predicts motor impairment and performance after stroke. Rehabil Res Pract. 2011;2011:1–7 Available from: http://www.hindawi.com/journals/rerp/2011/381978/.
Van Dokkum L, Hauret I, Mottet D, Froger J, Métrot J, Laffont I. The contribution of kinematics in the assessment of upper limb motor recovery early after stroke. Neurorehabil Neural Repair. 2014;28(1):4–12.
Chen HL, Lin KC, Liing RJ, Wu CY, Chen CL. Kinematic measures of arm-trunk movements during unilateral and bilateral reaching predict clinically important change in perceived arm use in daily activities after intensive stroke rehabilitation. J Neuroeng Rehabil. 2015;12(1):1–10. https://doi.org/10.1186/s12984-015-0075-8.
Rohrer B, Fasoli S, Krebs HI, Hughes R, Volpe B, Frontera WR, et al. Movement smoothness changes during stroke recovery. J Neurosci. 2002;22(18):8297–304 Available from: http://www.ncbi.nlm.nih.gov/pubmed/12223584.
Colombo R, Pisano F, Micera S, Mazzone A, Delconte C, Chiara Carrozza M, et al. Robotic techniques for upper limb evaluation and rehabilitation of stroke patients. IEEE Trans Neural Syst Rehabil Eng. 2005;13(3):311–24.
Colombo R, Pisano F, Mazzone A, Delconte C, Micera S, Carrozza MC, et al. Design strategies to improve patient motivation during robot-aided rehabilitation. J Neuroeng Rehabil. 2007;4:1–12.
Colombo R, Pisano F, Micera S, Mazzone A, Delconte C, Carrozza MC, et al. Assessing mechanisms of recovery during robot-aided neurorehabilitation of the upper limb. Neurorehabil Neural Repair [Internet]. 2008;22(1):50–63 Available from: http://journals.sagepub.com/doi/10.1177/1545968307303401.
Zollo L, Rossini L, Bravi M, Magrone G, Sterzi S, Guglielmelli E. Quantitative evaluation of upper-limb motor control in robot-aided rehabilitation. Med Biol Eng Comput. 2011;49(10):1131–44 Available from: http://link.springer.com/10.1007/s11517-011-0808-1.
Otaka E, Otaka Y, Kasuga S, Nishimoto A, Yamazaki K, Kawakami M, et al. Clinical usefulness and validity of robotic measures of reaching movement in hemiparetic stroke patients. J Neuroeng Rehabil. 2015;12:66 Available from: http://www.ncbi.nlm.nih.gov/pubmed/26265327.
Duret C, Courtial O, Grosmaire AG, Hutin E. Use of a robotic device for the rehabilitation of severe upper limb paresis in subacute stroke: exploration of patient/robot interactions and the motor recovery process. Biomed Res Int. 2015;2015:1.
Duret C, Courtial O, Grosmaire AG. Kinematic measures for upper limb motor assessment during robot-mediated training in patients with severe sub-acute stroke. Restor Neurol Neurosci. 2016;34(2):237–45.
Pila O, Duret C, Laborne FX, Gracies JM, Bayle N, Hutin E. Pattern of improvement in upper limb pointing task kinematics after a 3-month training program with robotic assistance in stroke. J Neuroeng Rehabil. 2017;14(1):1–10.
Dipietro L, Krebs HI, Fasoli SE, Volpe BT, Stein J, Bever C, et al. Changing motor synergies in chronic stroke. J Neurophysiol. 2007;98(2):757–68.
Gilliaux M, Lejeune T, Detrembleur C, Sapin J, Dehez B, Selves C, et al. Using the robotic device REAplan as a valid, reliable, and sensitive tool to quantify upper limb impairments in stroke patients. J Rehabil Med. 2014;46(2):117–25 Available from: http://www.medicaljournals.se/jrm/content/?doi=10.2340/16501977-1245.
Ellis MD, Sukal T, DeMott T, Dewald JPA. Augmenting clinical evaluation of hemiparetic arm movement with a laboratory-based quantitative measurement of kinematics as a function of limb loading. Neurorehabil Neural Repair. 2008;22(4):321–9.
McKenzie A, Dodakian L, See J, Le V, Quinlan EB, Bridgford C, et al. Validity of robot-based assessments of upper extremity function. Arch Phys Med Rehabil. 2017;98(10):1969–1976.e2 Available from: http://www.ncbi.nlm.nih.gov/pubmed/28483654.
Krebs HI, Krams M, Agrafiotis DK, DiBernardo A, Chavez JC, Littman GS, et al. Robotic measurement of arm movements after stroke establishes biomarkers of motor recovery. Stroke. 2014;45(1):200–4 Available from: http://www.ncbi.nlm.nih.gov/pubmed/24335224.
Cirstea MC, Levin MF. Compensatory strategies for reaching in stroke. Brain. 2000;123(5):940–53.
Wagner JM, Lang CE, Sahrmann S, Edwards DF, Dromerick AW. Sensorimotor impairments and the first few months of recovery. Phys Ther. 2007;87(6):751–65.
Subramanian SK, Yamanaka J, Chilingaryan G, Levin MF. Validity of movement pattern kinematics as measures of arm motor impairment poststroke. Stroke. 2010;41(10):2303–8.
Palermo E, Hayes DR, Russo EF, Calabrò RS, Pacilli A, Filoni S. Translational effects of robot-mediated therapy in subacute stroke patients: an experimental evaluation of upper limb motor recovery. PeerJ. 2018;2018(9):1–25.
Osu R, Ota K, Fujiwara T, Otaka Y, Kawato M, Liu M. Quantifying the quality of hand movement in stroke patients through three-dimensional curvature. J Neuroeng Rehabil. 2011;8(1):1–14.
Alt Murphy M, Willén C. Sunnerhagen KS. Kinematic variables quantifying upper-extremity performance after stroke during reaching and drinking from a glass. Neurorehabil Neural Repair. 2011;25, 71(1):–80 Available from: http://www.ncbi.nlm.nih.gov/pubmed/20829411.
Alt Murphy M, Willén C, Sunnerhagen KS. Movement kinematics during a drinking task are associated with the activity capacity level after stroke. Neurorehabil Neural Repair. 2012;26(9):1106–15 Available from: http://www.ncbi.nlm.nih.gov/pubmed/22647879.
Alt Murphy M, Willén C, Sunnerhagen KS. Responsiveness of upper extremity kinematic measures and clinical improvement during the first three months after stroke. Neurorehabil Neural Repair. 2013;27(9):844–53.
Thrane G, Alt Murphy M, Sunnerhagen KS. Recovery of kinematic arm function in well-performing people with subacute stroke: a longitudinal cohort study. J Neuroeng Rehabil. 2018;15(1):1–10.
Fasoli SE, Adans-Dester CP. A paradigm shift: rehabilitation robotics, cognitive skills training and function after stroke. Front Neurol. 2019;10:1088.
Toglia J, Fitzgerald KA, O’Dell MW, Mastrogiovanni AR, Lin CD. The mini-mental state examination and Montreal cognitive assessment in persons with mild subacute stroke: relationship to functional outcome. Arch Phys Med Rehabil [Internet]. 2011;92(5):792–8 Available from: https://linkinghub.elsevier.com/retrieve/pii/S0003999311000049.
Bohannon RW. Smith MB. Interrater reliability of a modified Ashworth scale of muscle spasticity. Phys Ther. 1987;67(2):206–7 Available from: http://www.ncbi.nlm.nih.gov/pubmed/3809245.
Coderre AM, Zeid AA, Dukelow SP, Demmer MJ, Moore KD, Demers MJ, et al. Assessment of upper-limb sensorimotor function of subacute stroke patients using visually guided reaching. Neurorehabil Neural Repair. 2010;24(6):528–41 Available from: http://www.ncbi.nlm.nih.gov/pubmed/20233965.
Balasubramanian S, Melendez-Calderon A, Burdet E. A robust and sensitive metric for quantifying movement smoothness. IEEE Trans Biomed Eng. 2012;59(8):2126–36 Available from: http://ieeexplore.ieee.org/document/6104119/.
Hinkle DE, Wiersma W, Jurs SG. Applied statistics for the behavioral sciences. Vol. 663. Houghton Mifflin college division; 2003.
Cohen J. The effect size index: d. Stat power Anal Behav Sci. 1988;2:284–8.
Page SJ, Fulk GD, Boyne P. Clinically important differences for the upper-extremity Fugl-Meyer scale in people with minimal to moderate impairment due to chronic stroke. Phys Ther. 2012;92(6):791–8.
Lin K, Hsieh Y, Wu C, Chen C, Jang Y, Liu J. Minimal detectable change and clinically important difference of the Wolf Motor function test in stroke patients. Neurorehabil Neural Repair. 2009;23(5):429–34 Available from: http://journals.sagepub.com/doi/10.1177/1545968308331144.
van der Lee JH, Beckerman H, Knol DL, de Vet HCW, Bouter LM. Clinimetric properties of the motor activity log for the assessment of arm use in Hemiparetic patients. Stroke. 2004;35(6):1410–4 Available from: https://www.ahajournals.org/doi/10.1161/01.STR.0000126900.24964.7e.
Holm S. A simple sequentially Rejective multiple test procedure. Scand J Stat. 1979;6(2):65–70 Available from: http://www.jstor.org/stable/4615733.
Ward NS, Brander F, Kelly K. Intensive upper limb neurorehabilitation in chronic stroke: outcomes from the queen square programme. J Neurol Neurosurg Psychiatry. 2019;90(5):498–506 Available from: http://jnnp.bmj.com/lookup/doi/10.1136/jnnp-2018-319954.
McCabe J, Monkiewicz M, Holcomb J, Pundik S, Daly JJ. Comparison of robotics, functional electrical stimulation, and motor learning methods for treatment of persistent upper extremity dysfunction after stroke: a randomized controlled trial. Arch Phys Med Rehabil. 2015;96(6):981–90.
Kwakkel G, van Wegen EEH, Burridge JH, Winstein CJ, van Dokkum LEH, Alt Murphy M, et al. Standardized measurement of quality of upper limb movement after stroke: consensus-based Core recommendations from the second stroke recovery and rehabilitation roundtable. Neurorehabil Neural Repair. 2019;33(11):951 Available from: http://www.ncbi.nlm.nih.gov/pubmed/31660781.
Patel S, Hughes R, Hester T, Patel BS, Hughes R, Hester T, et al. A novel approach to monitor rehabilitation outcomes in stroke survivors using wearable technology. Proc Annu Int Conf IEEE Eng Med Biol Soc. 2010;98:3 Available from: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5420034.
Del Din S, Patel S, Cobelli C, Bonato P. Estimating Fugl-Meyer clinical scores in stroke survivors using wearable sensors. Boston: IEEE Eng Med Biol Soc; 2011.
Lee SI, Adans-Dester C, O’Brien A, Diaz GV, Black-Schaffer R, Patel S, et al. Using wearable motion sensors to estimate longitudinal changes in movement quality in stroke and traumatic brain injury survivors undergoing rehabilitation. Arch Phys Med Rehabil. 2016;97(10):e117.
The authors would like to thank the study participants, Adam Clansey for his help labeling kinematic data, and Jean-Francois Daneault for his help during the data collections.
This work was supported by the MGH Institute of Health Professions and the Motion Analysis Laboratory at Spaulding Rehabilitation Hospital.
Ethics approval and consent to participate
The study was approved by the Partners Healthcare Institutional Review Board and all methods were carried out in accordance with the approved study protocol (record ID: 2015P002107). Participants provided written informed consent before their participation in the study.
Consent for publication
Written informed consent for publication was obtained from the study participants.
The authors have no financial interests related to the content of this manuscript.
Additional disclosures: GS has received grant support (as Principal Investigator) from the EU (H2020) and Enterprise Ireland. SF received funding support from the MGH Institute of Health Professions, Faculty Research Fellowship and would like to acknowledge a research loan of the Amadeo™ robot from Tyromotion (Graz, AT) for this pilot study. PB has received grant support from the American Heart Association, the Department of Defense, the Michael J Fox Foundation, the National Institutes of Health (NIH), the National Science Foundation (NSF), and the Peabody Foundation including sub-awards on NIH and NSF SBIR grants from Barrett Technology (Newton MA), BioSensics (Watertown MA) and Veristride (Salt Lake City UT). He has also received grant support from Emerge Diagnostics (Carlsbad CA), MC10 (Lexington MA), Mitsui Chemicals (Tokyo Japan), Pfizer (New York City NY), Shimmer Research (Dublin Ireland), and SynPhNe (Singapore). He serves in an advisory role the Michael J Fox Foundation, the NIH-funded Center for Translation of Rehabilitation Engineering Advances and Technology, and the NIH-funded New England Pediatric Device Consortium. He also serves on the Scientific Advisory Boards of Hocoma AG (Zurich Switzerland), Trexo (Toronto Canada), and ABLE Human Motion (Barcelona, Spain) in an uncompensated role. The other authors have no disclosures relevant to the study.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1: Figure S1A.
Variance observed across targets in the kinematic variables of efficiency in the non-paretic and paretic arm. Figure S1B. Variance observed across targets in the kinematic variables of speed and planning in the non-paretic and paretic arm. Figure S1C. Variance observed across targets in the kinematic variables of smoothness in the non-paretic and paretic arm. Figure S1D. Variance observed across targets in the kinematic variables of trunk posture in the non-paretic and paretic arm. Figure S1E. Variance observed across targets in the kinematic variables of arm posture in the non-paretic and paretic arm.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Adans-Dester, C., Fasoli, S.E., Fabara, E. et al. Can kinematic parameters of 3D reach-to-target movements be used as a proxy for clinical outcome measures in chronic stroke rehabilitation? An exploratory study. J NeuroEngineering Rehabil 17, 106 (2020). https://doi.org/10.1186/s12984-020-00730-1
- Clinical outcomes
- Robot-assisted therapy
- Upper extremity