- Open Access
Integrated robotics platform with haptic control differentiates subjects with Parkinson’s disease from controls and quantifies the motor effects of levodopa
Journal of NeuroEngineering and Rehabilitation volume 16, Article number: 124 (2019)
The use of integrated robotic technology to quantify the spectrum of motor symptoms of Parkinson’s Disease (PD) has the potential to facilitate objective assessment that is independent of clinical ratings. The purpose of this study is to use the KINARM exoskeleton robot to (1) differentiate subjects with PD from controls and (2) quantify the motor effects of dopamine replacement therapies (DRTs).
Twenty-six subjects (Hoehn and Yahr mean 2.2; disease duration 0.5 to 15 years) were evaluated OFF (after > 12 h of their last dose) and ON their DRTs with the Unified Parkinson’s Disease Rating Scale (UPDRS) and the KINARM exoskeleton robot. Bilateral upper extremity bradykinesia, rigidity, and postural stability were quantified using a repetitive movement task to hit moving targets, a passive stretch task, and a torque unloading task, respectively. Performance was compared against healthy age-matched controls.
Mean hand speed was 41% slower and 25% fewer targets were hit in subjects with PD OFF medication than in controls. Receiver operating characteristic (ROC) area for hand speed was 0.94. The torque required to stop elbow movement during the passive stretch task was 34% lower in PD subjects versus controls and resulted in an ROC area of 0.91. The torque unloading task showed a maximum displacement that was 29% shorter than controls and had an ROC area of 0.71. Laterality indices for speed and end total torque were correlated to the most affected side. Hand speed laterality index had an ROC area of 0.80 against healthy controls. DRT administration resulted in a significant reduction in a cumulative score of parameter Z-scores (a measure of global performance compared to healthy controls) in subjects with clinically effective levodopa doses. The cumulative score was also correlated to UPDRS scores for the effect of DRT.
Robotic assessment is able to objectively quantify parkinsonian symptoms of bradykinesia, rigidity and postural stability similar to the UPDRS. This integrated testing platform has the potential to aid clinicians in the management of PD and help assess the effects of novel therapies.
Parkinson’s Disease (PD) is a common neurodegenerative disorder that is characterized by bradykinesia/akinesia, rigidity, tremor and postural instability. Non-motor complications include autonomic and cognitive dysfunction . In order to manage these symptoms, patients are treated with dopamine replacement therapies (DRTs) . The progression of PD and the effects of therapy are assessed using the Unified Parkinson’s Disease Rating Scale (UPDRS). Part III of this scale results in a composite score of categorical variables for motor signs. However, the sensitivity of the UPDRS to the effect of therapies may be limited by inter-rater reliability , test-retest reliability , sensitivity , and bias .
Objective assessment technologies have the potential to complement the UPDRS and improve the clinical management of PD by providing greater uniformity between different physicians, care institutions and patients [25, 27, 37]. Devices that characterize the spectrum of signs in PD can be used to accurately distinguish patients with PD from healthy controls  and have a high test-retest reliability . A major challenge of implementing assessment technologies for PD is to bridge the gap between complex behavioural data and clinical usefulness .
KINARM (BKIN Technologies, Kingston, Canada) is a robot-based assessment system that has been extensively used to measure neurological function in subjects with stroke [3, 38]. The system provides an integrated robotics and virtual reality platform and haptic control, permitting assessment of a broad range of sensory, motor, and cognitive functions. In this study we used integrated platform to objectively assess subjects with PD. Using tasks to specifically quantify bradykinesia, rigidity, and postural stability we determined whether this technology could (1) differentiate subjects with PD from healthy controls and (2) quantify the effects of anti-parkinsonian medication compared to UPDRS scores. Importantly, subject performance in each task can be compared to healthy controls. Discriminating abnormal from normal behavior is how clinicians diagnose and manage neurologic diseases. All items in the UPDRS differentiate healthy performance (rated as 0) from mild to severe/marked. Implicit in this scale is the concept that the rater makes a value judgement on how categorically far away a subject’s performance is from healthy performance. They compare a patient’s rigidity/bradykinesia/etc. to the distribution of healthy performance measures based on their past experience. These categorical scores become independent of units and therefore can be summed to achieve a total score. Similarly, we quantified subject performance in Z-space in order to calculate a cumulative score of the disparate tests performed with the robotic system.
Participants with PD were recruited from a movement disorders clinic at Kingston Health Sciences Centre in Kingston, Ontario, Canada. Inclusion criteria for this study were a diagnosis of idiopathic PD undergoing treatment with DRTs, the ability to understand the clinical and robotic assessment tasks, normal or corrected to normal vision, and no injury limiting movement of the upper extremity. Robotic task performance for each subject was compared against age- and handedness-matched healthy control subjects (using group means with significance set at α = 0.01). Two hundred fifty controls were used for the object hit analysis (mean age 62 years, range 43–75), 174 controls for the object hit and avoid analysis (mean age 64 years, range 47–75), 27 controls for the elbow stretch task analysis (mean age 59 years, range 35–79), and 38 controls for the unloading task analysis (mean age 63 years, range 49–80) (see below for task descriptions). The discrepancy in the number of control subjects is due to control data being collected before and during the recruitment of study subjects and that the control participants did not necessarily perform all of the tasks. Controls subjects were carefully screened by the research assistant, data analyst, and BKIN technologies to exclude diagnoses with a disease or condition affecting the brain, spinal cord, or vision, and musculoskeletal diseases and injuries. In addition, healthy subjects with abnormal behaviour on one or more standard tasks as noted by Z-scores > 2 on multiple parameters on more than one standard task were excluded. In total ~ 5% of recruits were excluded from the control data. This study was approved by Queen’s University and the Kingston General Hospital Research Institute ethics board and informed consent was obtained from each subject.
Clinical assessment of Parkinson’s disease
Subjects with PD were instructed to stop taking their DRT medications after 6 pm the day before testing. One of two movement disorders neurologists administered Part III of the UPDRS during this “OFF” medication condition (SR tested 14 subjects, GP tested 12 subjects). The neurologists were not blinded to medication state. Subjects then completed the robotic test battery which took 15–20 min (see below). Upon completion, subjects were instructed to take their regularly scheduled dosages of DRTs. An hour rest period was given to each subject in order for their medications to be effective. The subjects then repeated the test battery and a movement disorders neurologist conducted Part III of the UPDRS to yield “ON” condition scores. Subjects were screened for dementia using the Montreal Cognitive Assessment (MoCA) scale during their ON condition. MoCA scores ranged from 20 to 30. Handedness was determined using the Edinburgh Handedness Inventory. The UPDRS and MoCA were not performed on the healthy controls.
Robotic assessments were performed with the bilateral KINARM exoskeleton (Fig. 1a; BKIN Technologies, Kingston, Canada; Scott, 1999 ). This device permits arm movement in the horizontal plane, involving elbow and shoulder motion, and provides haptic feedback or moves the limb in the workspace. A virtual reality system projects visual feedback onto the horizontal workspace. A black screen is used to block the subject’s sight of their arms. Hand position is represented by a white dot or horizontal paddle dependent on the task. The robotic testing battery consists of four sequential tasks (Fig. 1b). The object hit task and the object hit and avoid task were repetitive movement tasks that quantified bradykinesia and inhibitory control. Rigidity was quantified using the passive stretch task. Postural stability was quantified using a torque unloading task. The tasks are described in detail below.
Bradykinesia was quantified with two repetitive movement tasks that differed in complexity by the introduction of a cognitive load. The first was a simple repetitive reaching task called the object hit task and the second task, called the object hit and avoid task, required subjects to perform the same movements but to avoid hitting specific object shapes. In the object hit task, targets (2 cm diameter red balls) fell from the top of the viewing area towards the subjects (Fig. 1b, top row left panel). Subjects were instructed to hit away as many targets as possible within the task duration using 5 cm virtual paddles that corresponded to the position of their right and left hands . Subjects could hit these balls with either hand. At the start of the task, a single falling ball moving at 10 cm/s was visible in the workspace. By the end of the task a maximum of 16 balls moving at 50 cm/sec were present on the screen. A total of 300 balls were released into the workspace falling from 10 different locations across the workspace. Haptic feedback was provided for correct target hits. The total duration of this task was ~ 2.5 min.
The object hit and avoid task was used to complement the object hit task in the assessment of bradykinesia in order to determine if a higher cognitive load worsened motor performance. It has been previously reported that bradykinesia is negatively associated with cognitive flexibility, in subjects with PD . The objective of the object hit and avoid task was to hit as many ‘targets’ as possible while avoiding ‘distractors’. Two specific shapes were outlined as task targets at the start of the task. All other shapes were classified as distractors  (Fig. 1b, top row right panel). At the start of the task targets moved at 10 cm/s and increased to 50 cm/s by the end. A total of 200 targets and 100 distractors were released in the workspace from 10 different spatial locations. Haptic feedback was provided for correct target hits but not provided for distractor hits (i.e. trial errors). The total duration of this task was ~ 2.5 min.
The passive stretch task quantified rigidity over a continuous range at 2 different velocities (Fig. 1b, bottom row, left panel). The robotic system passively moved the elbow through flexion and extension between the angles of 65o and 145o while the shoulder was fixed at 60o . A single trial involved a flexion movement from 145o to 65o, a 3 to 6 s wait period and an extension movement from 65o back to 145o . At the beginning and end of each movement, torque could continue to be applied (blue arrow in Fig. 1b) in order to push the joint towards the desired location (i.e. some subjects exhibited baseline tone during the wait period). Each flexion and extension movement followed a bell-shaped velocity profile using a torque to accelerate the limb in a given direction and torque in the opposite direction of limb motion to slow down the limb at the end joint angle (see Fig. 1c). There were 5 flexion movements and 5 extension movements at two different movement times (600 ms and 1500 ms). Each elbow was tested separately with a total assessment time of ~ 2 min.
Lastly, the unloading task was used to model postural instability by testing how subjects corrected for a sudden change in upper limb posture (Fig. 1b, bottom row, right panel). The task began with a subject holding the white dot representative of their hand on a central red target . A constant torque was applied to the elbow (±0.5 Nm) or shoulder (±1 Nm). The subject was asked to resist the load in order to maintain the cursor inside the central target. After a brief and random delay, the constant torque was quickly removed causing a displacement in the tested limb. Participants were instructed to move the hand back to the central target as quickly as they could. Visual feedback of the hand cursor was provided for the first 8 trials and afterwards, the hand cursor was extinguished at the onset of the unloading, requiring participants to use proprioception to return the hand back to the target location. There were 16 trials for each load condition presented in a random block design. Each arm was tested separately and total assessment time was ~ 8 min.
Robotic data was recorded online with the KINARM embedded software (Dexterit-E version 3.5.4, BKIN Technologies, Kingston, Canada). The software automatically quantified subject performance using a number of parameters capturing spatial or temporal features of each task. These parameters were converted into normalized Z-scores based on performance of a large cohort of healthy controls and included the influence of sex, age and handedness . Statistical analysis was performed using Sigmaplot (Version 11.0, Systat Software Inc.) and Matlab (version R2015b, MathWorks). In subjects with PD, a total UPDRS part III score, a bradykinesia score (sum of items 23–26; maximum of 32 points), an upper extremity bradykinesia score (sum of items 23, 24, 25; maximum of 12 points for each side), a rigidity score (sum of item 22; maximum of 20 points), an upper extremity rigidity score (item 22, maximum of 4 points for each side), and a posture score (item 30) were calculated for the OFF and ON conditions. The mean hand performance for the right and left hands were averaged for each parameter. All analyses except the asymmetry analysis incorporated the averaged parameter values. In order to determine body side asymmetries for bradykinesia and rigidity, the right minus left side difference between UPDRS items 22–26 were calculated when subjects were OFF medication .
In all subjects who performed object hit and object hit and avoid tasks to quantify bradykinesia, mean hand speed (m/s), total target hits, and movement area (area covered by both hands in the workspace, m2) were calculated [4, 41]. The total distractors hit were also considered in the object hit and avoid task.
In PD, increased rigidity requires more torque to move the limb and less torque to decelerate to a stop. Parkinsonian velocity-independent rigidity was calculated from the passive stretch task by integrating the torque (Nm) required to accelerate the forearm to the maximum velocity (“start total torque”) and then decelerate it back to rest (“end total torque”) (Fig. 1c). “Hold torque” was defined as the integrated torque required to maintain no movement for 1 s during the wait period (from 1.5–0.5 s before start of movement). This was measured to determine whether subjects were resisting the robot at the end points of movement and displaying passive rigidity . Peak speed (rad/s) of the forearm was also calculated to assess for velocity dependent increases in tone. The start/end total torques, hold torque, and peak speeds were calculated for each flexion and extension movement for each arm (Fig. 1c). Preliminary analysis revealed that the parameters were most effective at identifying rigidity for the 600 ms (i.e faster) stretches (see Additional file 1), therefore, the results are presented for that movement time only. Values for flexion and extension movements were averaged.
To quantify postural stability in the unloading task the deceleration time (ms), maximum displacement (m), return time (ms) and endpoint error (m) of the cursor representing the hand position were calculated . The maximum displacement was considered as the distance the hand traveled away from the red target upon the load release. Deceleration time represented how quickly the subject reacted to the load release. Return time was defined as how quickly the subject was able to return to the red target after the maximum displacement was reached. Finally, endpoint error was calculated by determining the hand distance from the centre red target at the end of the movement. Mean values for the right and left hands were averaged for each parameter.
Comparisons between groups were made with Student’s t-test and in case of non-normal data Mann-Whitney Rank Sum Test. The paired t-test or the Wilcoxon Signed Rank Test was used with paired data. Normality was determined using the Shapiro-Wilk test. Receiver operating characteristic (ROC) curves were used to assess the predictive accuracy of the KINARM test battery parameters to discriminate subjects with PD from healthy controls. A high discriminatory ability is represented by an area under the curve (AUC) that approaches 1 while a test that cannot differentiate the test populations has an AUC near 0.5. Differences between ROC curves were compared with the Chi-square test.
To quantify side-to-side asymmetry in PD during bimanual tasks, asymmetrical robotic performance between arms was quantified using a laterality index that was defined as the absolute difference between right arm and left arm parameters divided by the sum of both arms (Scharoun et al., 2015). ROC analysis for asymmetry was performed with absolute values of laterality indices and most affected UPDRS side.
Correlations of robotic measures with UPDRS scores, DRT dose, and MOCA scores were performed using Spearman Rank Order Correlation. Significance was set at p < 0.05.
A cumulative score was used as a measure of global performance in subjects with PD versus healthy controls and to facilitate comparisons with summed UPDRS bradykinesia, rigidity, and posture categorical item scores. Z-scores were first calculated for each task parameter based on performance from a large cohort of healthy control subjects . The cumulative score was determined by calculating the root-sum-square distance of Z-scores for parameters within each task that showed a significant effect of DRT. We used the robotic parameters that showed a significant effect of DRT in the analysis since they are more sensitive to changes in PD state and can differentiate patients from control and OFF and ON states.
Twenty-six participants diagnosed with idiopathic PD undergoing treatment with DRTs were recruited from a movement disorders clinic. Subject characteristics are shown in Table 1. Subjects were between ages 47 and 75 years old (mean: 64.9, standard deviation: 8.7, SD) with their disease duration ranging from 0.5 to 15 years (mean: 5.5 years, SD: 3.4). The Hoehn and Yahr stage range was 2–3 (mean: 2.2, SD: 3.4). There were 22 right hand and 4 left hand dominant subjects. Mean levodopa dosage was 750 mg (range: 300 – 1375 mg). In addition to levodopa, seven subjects were taking pramipexole, three entacapone, one amantadine, one rasagiline, one trihexyphenidyl, one propranolol, and one with a rotigotine patch.
Differentiation of PD subjects OFF medication from healthy controls
All subjects were able to complete the object hit task and the object hit and avoid task in both “OFF” and “ON” drug states. Table 2 compares their robotic task performance OFF DRT to the performance of healthy controls. In the object hit task, mean hand speed was 41% slower, movement area was 31% smaller, and subjects hit 25% fewer targets than controls. In the object hit and avoid task, mean hand speed was 47% slower, movement area was 40% smaller, and 23% fewer targets were hit. ROC analysis for each parameter is listed in Table 2.
ROC analysis comparing how robotic task performance parameters discriminated subjects OFF DRT from controls for the object hit task and object hit and avoid task are displayed in Fig. 2a and b, respectively. The parameter with the highest predictive accuracy was the mean hand speed in the object hit task with AUC = 0.94 and in the object hit and avoid task with AUC = 0.93. There was no statistical difference between the AUCs for mean hand speed between these tasks (Chi-square test, χ2 (1, N = 200) = 0.17, P = 0.68) indicating that the addition of distractors did not improve the predictive accuracy of mean hand speed in differentiating subjects with PD from controls.
One of the 26 subjects with PD was not able to perform the passive stretch task with one arm during the OFF condition due to discomfort (but was able to perform with both hands in the ON condition) and was excluded from all of the rigidity analyses. This subject’s UPDRS rigidity score ratings in the OFF DRT state were right arm = 0, right leg = 1, left arm = 1, left leg = 1, and neck = 0 (total OFF UPDRS rigidity score = 3). In comparison to the total OFF UPDRS rigidity score of the group, three other subjects scored 3, one scored a 2, and the rest were 4 or greater (median = 7). End total torques were 34% lower, the total torque difference (defined as difference between total start and total end torque per subject) was 64% higher, hold torque was 3.6 times greater, and peak speeds were 9% slower in the subjects with PD versus controls (Table 2). Figure 2c shows the ROC for these parameters where the highest predictive accuracy was end total torque with AUC = 0.91 (95% Confidence Interval: 0.82–0.99).
The same subject that could not complete the passive stretch task did not perform the unloading task. Deceleration time (ms) after force unloading was 9% faster and maximum displacement was 29% shorter in subjects with PD than controls (Table 2). Figure 2d shows ROC for these parameters and return time and endpoint error. The highest predictive accuracy of a parameter was maximum displacement with AUC = 0.71 (95% Confidence Interval: 0.57–0.85).
Task performance correlations to OFF UPDRS
The subjects mean UPDRS Part III scores OFF medication was 29.7 (SD = 10.6). Their UPDRS ratings correlations to robotic task performance is shown in Table 2 (right most column). The mean UPDRS bradykinesia score OFF DRT was 12.6 (SD = 5.4) (items 23–26, maximum score = 32). The best correlation with UPDRS bradykinesia scores was for mean hand speed in the object hit task and object hit and avoid task. Correlations of just upper extremity UPDRS bradykinesia scores (items 23–25, maximum score = 24) with hand speeds were not as highly significant (Spearman Rank Order Correlation, Correlation Coefficient = − 0.5 and − 0.588, P < 0.01 for each task). The mean rigidity UPDRS score OFF DRT was 6.7 (SD = 3.2) (item 22; maximum score = 20). UPDRS rigidity scores were best correlated with end total torques in the passive stretch task. There was no significant correlations with only upper extremity rigidity (maximum score = 8) (Spearman Rank Order Correlation, P = 0.21). None of the 4 parameters in the unloading task were correlated to the UPDRS posture stability score (item 30, maximum score = 4).
Asymmetry bimanual tasks
Correlations to UPDRS score asymmetries were performed with single robotic parameters that displayed the highest ROC areas. Laterality indices for hand speed in object hit task and object hit and avoid task, and end total torques in the passive stretch task were compared to UPDRS score asymmetries in subjects in the OFF condition. Figure 3a shows a correlation between the laterality index for object hit task hand speed and UPDRS bradykinesia score asymmetries (Spearman Rank Order Correlation, correlation co-efficient = − 0.65, P < 0.001). Similarly, object hit and avoid task hand speed laterality index correlated with the UPDRS bradykinesia score asymmetries (Spearman Rank Order Correlation, correlation co-efficient = − 0.666, P < 0.001) (not shown). There was a significant correlation between the most affected side for rigidity and laterality index for end total torque (Spearman Rank Order Correlation, correlation co-efficient = − 0.566, P < 0.01) (Fig. 3b). ROC analysis revealed that the only parameter that discriminated subjects from controls was hand speed asymmetry in either the object hit task and object hit and avoid tasks (significant ROC curve areas = 0.80 and 0.81, respectively; 95% confidence interval 0.68–0.92, P < 0.0001) (Fig. 3c).
A minimal clinical improvement  was defined as a reduction in the total UPDRS part 3 of greater than six points. This minimal clinical difference was observed in 20 of 26 subjects after DRT. This cut off was used to ensure a clinical effect of DRT because the dose of levodopa was not uniform across all subjects and each likely had a different sensitivity to the drug. The total UPDRS part 3 score in these 20 patients decreased from 32 to 16 (Wilcoxon Signed Rank Test, Z = − 3.933, P < 0.001). Bradykinesia UPDRS score decreased from 13 to 6.5 (Wilcoxon Signed Rank Test, Z = − 3.925, P < 0.001), rigidity decreased from 7.1 to 4 (paired t-test, t = 8.498, P < 0.001), but there was no change in postural stability (median = 0) (Wilcoxon Signed Rank Test, Z = − 2.121, P = 0.063)(Fig. 4a).
The summary data for the effects of DRT on robotic parameters in the 20 subjects with the minimal clinical improvement is shown in Table 3. In object hit and avoid task, (but not the object hit task), mean hand speed increased by 28% with DRT. Total hits increased due to DRT administration in both object hit task (median 163 to 179) and the object hit and avoid task (mean 97 to 106). End total torque in the passive stretch task was not changed by medication. Maximum displacement was 11% greater in the unloading task (and closer to healthy control performance) following medication.
All 26 subjects were used to correlate the change in UPDRS scores and robotic parameters after DRT in order to determine if both tests were consistent in showing larger improvements for the minimal clinical difference groups and no improves/small improvement for those who did not display a minimal clinical difference. The total UPDRS part 3 score in all 26 patients decreased from 30 to 16 (paired t-test, t = 7.812, P < 0.001). In object hit task, the increase in mean hand speed was correlated to the decrease in UPDRS bradykinesia scores (Table 3). In object hit and avoid task, the correlations were more significant than the object hit task with the increase in mean hand and total hits being highly correlated to the decrease in UPDRS bradykinesia scores. For the 25 subjects with PD that were able to complete the passive stretch task, rigidity changes quantified by end total torques were not correlated to UPDRS improvement. Similarly, the change in maximum displacement in the unloading task was not correlated to UPDRS improvement.
In the 20 subjects that exhibited minimal clinical differences in total UPDRS part III scores, the UPDRS cumulative score (sum of bradykinesia, rigidity, and posture items) decreased from 21 to 11 (paired t-test, t = 7.833, P < 0.001). The robotic cumulative score (the root-sum-square distance of the Z-scores) was used as a measure to directly compare the combined performance on all 4 tasks with UPDRS score. The robotic parameters Z-scores that exhibited a significant change (P < 0.05) following DRT were number of target hits in object hit task, the number of target hits, mean hand speed, movement area in object hit and avoid task, hold torque in the passive stretch task, and maximum displacement in the unloading task. In these 20 subjects the robotic cumulative score was 4.5 OFF medication and decreased to 3.8 ON medication (paired t-test, t = 3.041, P < 0.01). There was a significant correlation between robotic cumulative score and the sum of UPDRS scores for bradykinesia, rigidity, and posture stability for all 26 subjects (Spearman Rank Order Correlation, Correlation Coefficient = 0.64, P < 0.001) (Fig. 4b). The six subjects that did not meet the criteria for minimal clinical difference using the total UPDRS part 3 can be observed in the top right of the figure (open white circles).
The number of distractor hits in the object hit and avoid task was not different between OFF medication subjects and healthy controls (Table 2). The number of distractors hit in the object hit and avoid task was increased with DRT from 17 to 26 in the 20 subjects with the minimal clinical improvement (Table 3) and from 18 to 26 in all 26 subjects (paired t-test, t = − 4.150, P = < 0.001). This increase was elevated compared with healthy controls (Mann-Whitney Rank Sum Test, U = 1121, P < 0.001). In all subjects, the DRT related increase in distractor hits was significantly correlated to the reduction in the sum of UPDRS bradykinesia, rigidity, and posture scores (Spearman Rank Order Correlation, correlation co-efficient = − 0.63, P < 0.001) (Fig. 4c). No correlations were observed with MoCA scores (Spearman Rank Order Correlation, correlation co-efficient = − 0.250, P = 0.215), levodopa dose (Spearman Rank Order Correlation, correlation co-efficient = 0.110, P = 0.590), or years with PD (Spearman Rank Order Correlation, correlation co-efficient = 0.248, P = 0.219)].
The current study demonstrates the utility of integrated robotic assessment of the multiple signs of PD. The platform was able to differentiate subjects with PD from healthy controls based on upper limb bradykinesia, rigidity, postural stability, and limb asymmetry metrics. It was able to be used by subjects with both strong and weak motor symptoms (as per their high and low UPDRS scores) and no floor or ceiling effects were encountered. The ROC analysis demonstrated high distinguishability between PD subjects and controls in all four robotic tasks and was able to separate PD subjects from controls using a simple laterality index. After the administration of DRT, both individual robotic parameters and the robotic cumulative scores moved closer to healthy control values. There was a significant correlation between the robotic cumulative scores and UPDRS cumulative scores after DRT administration.
Our study supports the use of technologies that quantify multiple parkinsonian signs into a summary score to accurately differentiate subjects from healthy controls . In the UPDRS assessments in the present study, cumulative scores were more sensitive to the effects of DRTs. In the case of bradykinesia and mean hand speed, the most significant correlations were observed when the full bradykinesia score was compared (items 23–26) rather than just upper extremity scores. UPDRS rigidity and end total torque were correlated when the full rigidity score was used (item 22; maximum score = 20) rather than just the upper limbs indicating that adding multiple items in the UPDRS increases the power of this clinical scale in quantifying the signs of PD. Similarly, we found that the robotic cumulative score was more sensitive to the effect of DRT rather than individual Z-score parameters. The highest predictive accuracy was given by mean hand speed (AUC = 0.94 in object hit task) indicating that no single task completely separated all subjects with PD from healthy control performance. There were likely some healthy controls who performed poorly on individual tasks and were indistinguishable from subjects with mild disease that performed well (for patients with PD). This is consistent with clinical reasoning. A patient may move slightly slower than normal for a variety of reasons such as neurological, musculoskeletal, age, medications, task complexity etc. But if any patient also has mild rigidity, rest tremor, and asymmetry these together may diagnose PD. This suggests that the robotic cumulative score, similar to the UPDRS Part 3, rather than individual tasks is better to objectively and accurately track the progression and treatment of clinically relevant parkinsonian signs .
In both the object hit task and object hit and avoid task, mean hand speed and limb asymmetries showed high discriminatory abilities in differentiating subjects with PD from healthly controls. Our findings support similar observations of mean hand speed by Wiratman et al.  using the KINARM object hit and avoid task. Mean hand speed and limb asymmetries had significant correlations with UPDRS bradykinesia scores when subjects were OFF medication. Although we expected the introduction of a higher cognitive load using distractors in the object hit and avoid task would substantially increase the task’s discriminatory ability , there was no significant effect. However, the effects of DRT on bradykinesia were more significant in the object hit and avoid task than in the object hit task. The administration of DRTs has been implicated in increased cognitive flexibility in PD  and DRTs have been shown to improve Parkinsonian performance on tasks with higher cognitive loads, when compared to their OFF performance. For example, Costa et al.  reported significant improvements in Parkinsonian performance on tasks that required higher flexibility measures (i.e. interference condition of the Stroop task) after DRT administration.
Similar to bradykinesia, the robotic platform was able to differentiate rigidity in subjects with PD compared to healthy controls. The parameter “end total torque” in the passive stretch task displayed a higher discriminatory ability in the differentiation of PD from healthy controls. Furthermore, the quantification of PD rigidity using end torque values was correlated to the UPDRS OFF medication scores. The single subject who was unable to complete rigidity testing had a low clinical rigidity score. This suggests that the severity of clinical rigidity does not limit testing with the exoskeleton. The most affected side that was identified by the UPDRS OFF medication (right minus left side score difference within UPDRS item 22) was correlated with greater end total torque in the passive stretch task. However, contrary to the change in UPDRS rigidity scores with DRT, none of the parameters from the passive stretch task showed a change following DRT administration. These discrepancies are likely due to several factors. First, both neurologists were not blinded to the subject’s medication state and could have overestimated the change in rigidity. Since clinicians are aware of the subject’s medication state and familiar with what is expected to be seen in that given state, they can be prone to rely on their previous experiences and introduce a level of bias . Second, end total torque may not be the optimum way to quantify rigidity and could be improved by development of a rigidity task score that encompasses many parameters during this task. Third, the two methodologies for rigidity testing also differ in that the clinicians tested multiple joints in the upper limb whereas the robot only tested the elbow.
By constraining the subjects upper extremities, the robot can move the arm to reach a peak velocity and produces a consistent measure of the torque needed to move and stop the limb. Our study supports measuring rigidity with the use of servo-motors  and similar technologies, like a supported test rig  or haptic technology , to passively move a joint through flexion and extension motions. Parameters such as torque , resistive torque  and angular impulse  are used to quantify increases in muscle tone and the position of the elbow joint during a flexion-extension movement and are highly correlated with the UPDRS. While handheld force sensors that are coupled with the rater’s passive movement of a limb at the joint can be used [22, 32] there is less control of limb velocity which can cause discrepancies in the measured tone. Electromyography recordings can be implemented to avoid constraining patients and have shown to correlated with enhanced stretch-related increases in activity . However, as mentioned by Park et al.  the accuracy of EMG recordings depends on the condition of electrodes and soft tissue, which is responsible for the production of weak correlations between UPDRS and EMG-rigidity measures.
The unloading task was able to differentiate PD subjects from healthy controls where maximum displacement was 29% shorter in subjects OFF medication in comparison to controls. This may be due to increases in rigidity after the > 12 h DRT washout period where the constant random force released may not have ben large enough to overcome the increased antagonist muscle tone. One hour after DRT administration, subjects limbs were not as rigid therefore producing maximum displacement values that were greater than OFF values and were more similar to healthy controls. This is in contrast to the UPRDS scale which did not show a DRT effect on postural stability. This discrepancy may be due to the UPDRS scale’s predictable quantification of postural instability. Item 30 of the UPDRS measures postural instability using the pull test. Patients are ready to receive a destabilizing pull from clinicians in which they are expected to recover. Prior to the pull patients stiffen their bodies to meet the force of the clinician, which can confound the postural results. Furthermore, the item does not consider how far a patient is displaced or how quickly they react to the pull. Factors such as postural sway, which assesses changes in an individual’s centre of gravity can also be used to quantify a patient’s tendency to fall or balance . In particular, abnormalities in postural sway can also be a reliable measure for assessing changes in postural instability in the PD population  and can be measured by a portable device like a tablet or smartphone [12, 28]. The KINARM Endpoint variant with an adjustable height does have the ability to measure postural sway by having the subject perform the task in a standing position with the addition of force plates on the robotic platform [11, 23]. Importantly, a comparison between upper limb postural stability as measured with the KINARM to other methods of gait and posture analysis should be performed.
The increase in distractor hits in the object hit and avoid task reflects a measure of worsening sensorimotor control after DRT administration when compared to healthy controls or the OFF medication state. This increase was inversely correlated with a reduction in UPDRS cumulative scores. The increase in distractor hits relative to controls is consistent with a recent study by Wiratman et al.  using the KINARM that demonstrated that patients with poor performance on standard cognitive batteries had higher distractor hits. In the present study no correlations were observed with MoCA scores but this may be due to limitations in using the MoCA to quantify cognitive function in subjects with PD. These observations highlight that robotic technology is useful to objectively quantify cognitive dysfunction in addition to motor performance.
In contrast to Wiratman et al.  we found an effect of DRT on distractor hits whereby patients that had a larger reduction on the cumulative UPDRS score with DRT hit more distractors (see Fig. 4c). This increase in task errors may be due to effects of DRT on impulsivity . Dopamine’s role in impulsivity has been correlated with the D2/D3 autoreceptor in the substantia nigra/ventral tegmental area . A lower D2/D3 receptor availability is also associated with enhanced dopamine release in the striatum . In PD, DRTs exert their effects by directly activating D1 and D2 receptors over a persistent but non-physiological period of dopamine release . Although beneficial at alleviating motor symptoms of PD, the persistent stimulation has been hypothesized to produce an “overdose” of ventral striatal-cortical stimulation, where consequences manifest as impulsive control disorders .
The primary limitation of our study is the non-blinding and randomization of medicated vs. non-medicated states for UPDRS assessment. Both clinicians were aware that the subject was OFF or ON medication and this may have introduced clinical bias . Lastly, we were not able to quantify tremor or dyskinesia due to the physical constraints of the exoskeleton arms. Rest tremor is a primary sign of PD and dyskinesia is a potentially debilitating side effect of medication . Inclusion of these signs into the robotic battery would improve its sensitivity and specificity for PD that may be possible with the KINARM Endpoint robot or related technologies that have force sensors in the handle grasped by the subject. In addition, the combination of parameters that were used to calculate the robotic cumulative score could not be directly compared to the controls due to the fact that different control subjects performed different sets of tasks. Given that there were greater differences between healthy controls and subjects with PD it is likely that a robotic cumulative score for healthy subjects perform all the tasks would better differentiate subjects with PD from healthy controls.
The current study validates the use of the integrated robotic technology to quantify the signs of bradykinesia, rigidity and limb postural instability of PD. Similar to the addition of items in the UPDRS, we found that the robotic cumulative score was more sensitive to the effect of DRT in comparison to individual robotic parameters. This platform has the potential to be used a diagnostic tool to differentiate subjects with PD from healthy individuals and to objectively quantify the effect of dopaminergic medication and other therapies.
Availability of data and materials
The datasets used and analysed during the current study are available from the corresponding author upon reasonable request.
Dopamine replacement therapies
Montreal Cognitive Assessment
Receiver operating characteristic
Unified Parkinson’s Disease Rating Scale
Arora S, Venkataraman V, Zhan A, Donohue S, Biglan KM, Dorsey ER, Little MA. Detecting and monitoring the symptoms of Parkinson’s disease using smartphones: a pilot study. Parkinsonism Relat Disord. 2015;21(6):650–3. https://doi.org/10.1016/j.parkreldis.2015.02.026.
Błaszczyk JW, Orawiec R, Duda-Kłodowska D, Opala G. Assessment of postural instability in patients with Parkinson's disease. Exp Brain Res. 2007;183(1):107-14. Epub 2007 Jul 4. PMID: 17609881.
Bourke TC, Coderre AM, Bagg SD, Dukelow SP, Norman KE, Scott SH. Impaired corrective responses to postural perturbations of the arm in individuals with subacute stroke. J Neuroeng Rehabil. 2015;12:7 https://doi.org/10.1186/1743-0003-12-7.
Bourke TC, Lowrey CR, Dukelow SP, Bagg SD, Norman KE, Scott SH. A robot-based behavioural task to quantify impairments in rapid motor decisions and actions after stroke. J Neuroeng Rehabil. 2016;13(1):1–13. https://doi.org/10.1186/s12984-016-0201-2.
Brewer BR, Pradhan S. Preliminary investigation of test-retest reliability of a robotic assessment for Parkinson’s disease. In: 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC’10; 2010. p. 5863–6. https://doi.org/10.1109/IEMBS.2010.5627519.
Buckholtz JW, Treadway MT, Cowan RL, Woodward ND, Li R, Ansari MS, et al. Dopaminergic network differences in human impulsivity. Science. 2010;329(July):532. https://doi.org/10.1126/science.1185778.
Centen A, Lowrey CR, Scott SH, Yeh TT, Mochizuki G. KAPS (kinematic assessment of passive stretch): a tool to assess elbow flexor and extensor spasticity after stroke using a robotic exoskeleton. J Neuroeng Rehabil. 2017;14(1):1–13. https://doi.org/10.1186/s12984-017-0272-8.
Costa A, Peppe A, Mazzù I, Longarzo M, Caltagirone C, Carlesimo GA. Dopamine treatment and cognitive functioning in individuals with Parkinson's disease: the "cognitive flexibility" hypothesis seems to work. Behav Neurol. 2014;2014:260896. https://doi.org/10.1155/2014/260896. Epub 2014 Jan 30. PMID: 24825952.
Davie CA. A review of Parkinson’s disease. Br Med Bull. 2008;86(1):109–27. https://doi.org/10.1093/bmb/ldn013.
Dierijck J, Kennefick M, Smirl J, Dalton BH, van Donkelaar P. Attention is required to coordinate reaching and postural stability during upper limb movements generated while standing. J Mot Behavior Mar. 2019;27:1–10. https://doi.org/10.1080/00222895.2019.1587351.
Ellis RJ, Ng YS, Zhu S, Tan DM, Anderson B, Schlaug G, Wang Y. A validated smartphone-based assessment of gait and gait variability in Parkinson’s disease. PLoS One. 2015;10(10). https://doi.org/10.1371/journal.pone.0141694.
Espay AJ, Bonato P, Nahab FB, Maetzler W, Dean JM, Klucken J, Eskofier BM, Merola A, Horak F, Lang AE, Reilmann R, Giuffrida J, Nieuwboer A, Horne M, Little MA, Litvan I, Simuni T, Dorsey ER, Burack MA, Kubota K, Kamondi A, Godinho C, Daneault JF, Mitsi G, Krinke L, Hausdorff JM, Bloem BR, Papapetropoulos S. Movement Disorders Society Task Force on Technology. Technology in Parkinson’s disease: challenges and opportunities. Mov Disord. 2016;31(9):1272–82. https://doi.org/10.1002/mds.26642 Epub 2016 Apr 29. Review. PMID: 27125836.
Fung VSC, Burne JA, Morris JGL. Objective quantification of resting and activated parkinsonian rigidity: a comparison of angular impulse and work scores. Mov Disord. 2000;15(1):48–55 https://doi.org/10.1002/1531-8257(200001)15:1<48::AID-MDS1009>3.0.CO;2-E.
Haaxma CA, Bloem BR, Borm GF, Horstink MWIM. Comparison of a timed motor test battery to the unified Parkinson’s disease rating scale-III in Parkinson’s disease. Mov Disord. 2008;23(12):1707–17. https://doi.org/10.1002/mds.22197.
Hauser RA, Gordon MF, Mizuno Y, Poewe W, Barone P, Schapira AH, Rascol O, Debieuvre C, Fräßdorf M. Minimal clinically important difference in Parkinson’s disease as assessed in pivotal trials of pramipexole extended release. Parkinsons Dis. 2014;2014:467131. https://doi.org/10.1155/2014/467131.
Heldman DA, Giuffrida JP, Chen R, Payne M, Mazzella F, Duker AP, Sahay A, Kim SJ, Revilla FJ, Espay AJ. The modified bradykinesia rating scale for Parkinson’s disease: reliability and comparison with kinematic measures. Mov Disord. 2011;26(10):1859–63. https://doi.org/10.1002/mds.23740.
Heldman DA, Espay AJ, LeWitt PA, Giuffrida JP. Clinician versus machine: reliability and responsiveness of motor endpoints in Parkinson’s disease. Parkinsonism Relat Disord. 2014;20(6):590–5. https://doi.org/10.1016/j.parkreldis.2014.02.022.
Hisahara S, Shimohama S. Dopamine receptors and Parkinson’s disease. Int J Med Chem. 2011;2011:1–16. https://doi.org/10.1155/2011/403039.
Hróbjartsson A, Thomsen AS, Emanuelsson F, Tendal B, Hilden J, Boutron I, Ravaud P, Brorson S. Observer bias in randomized clinical trials with measurement scale outcomes: a systematic review of trials with both blinded and nonblinded assessors. CMAJ. 2013;185(4):E201–11. https://doi.org/10.1503/cmaj.120744.
Jankovic J. Parkinson’s disease: clinical features and diagnosis. J Neurol Neurosurg Psychiatry. 2008;79(4):368–76. https://doi.org/10.1136/jnnp.2007.131045.
Little S, Raed J, Huiling T, Pogosyan A, Forrow B, Joint C, et al. A torque-based method demonstrates increased rigidity in Parkinson’s disease during low-frequency stimulation. Exp Brain Res. 2012;219:499–506.
Lowrey C, Nashed JY, Scott SH. Rapid and flexible whole-body postural responses are evoked from perturbations to the upper limb during goal-directed reaching. J Neurophysiol. 2017;117:1070–83. https://doi.org/10.1152/jn.01004.2015.
Lowrey CR, Bourke TC, Bagg SD, Dukelow SP, Scott SH. A postural unloading task to assess fast corrective responses in the upper limb following stroke. J Neuroeng Rehabil. 2019;16(1):16. https://doi.org/10.1186/s12984-019-0483-2 PMID: 30691482.
Maetzler W, Klucken J, Horne M. A clinical view on the development of technology-based tools in managing Parkinson’s disease. Mov Disord. 2016;31(9):1263–71. https://doi.org/10.1002/mds.26673.
Meara RJ, Cody FW. Relationship between electromyographic activity and clinically assessed rigidity studied at the wrist joint in Parkinson's disease. Brain. 1992;115(Pt 4):1167-80. PMID: 1393509.
Merola A, Sturchio A, Hacker S, Serna S, Vizcarra JA, Marsili L, Fasano A, Espay AJ. Technology-based assessment of motor and nonmotor phenomena in Parkinson disease. Expert Rev Neurother. 2018;18(11):825–45. https://doi.org/10.1080/14737175.2018.1530593 Epub 2018 Oct 8. PMID: 30269610.
Ozinga SJ, Machado AG, Miller Koop M, Rosenfeldt AB, Alberts JL. Objective assessment of postural stability in Parkinson’s disease using mobile technology. Mov Disord. 2015;30(9):1214–21. https://doi.org/10.1002/mds.26214.
Park BK, Kwon Y, Kim JW, Lee JH, Eom GM, Koh SB, et al. Analysis of viscoelastic properties of wrist joint for quantification of parkinsonian rigidity. IEEE Trans Neural Syst Rehabil Eng. 2011;19(2):167–76. https://doi.org/10.1109/TNSRE.2010.2091149.
Post B, Merkus MP, de Bie RMA, de Haan RJ, Speelman JD. Unified Parkinson’s disease rating scale motor examination: are ratings of nurses, residents in neurology, and movement disorders specialists interchangeable? Mov Disord. 2005;20(12):1577–84. https://doi.org/10.1002/mds.20640.
Powell D, Hanson N, Joseph Threlkeld A, Fang X, Xia R. Enhancement of parkinsonian rigidity with contralateral hand activation. Clin Neurophysiol. 2011;122(8):1595–601. https://doi.org/10.1016/j.clinph.2011.01.010 Enhancement.
Prochazka A, Bennett DJ, Stephens MJ, Patrick SK, Sears-duru R, Roberts T, Jhamandas JH. Measurement of rigidity in Parkinson’s disease. Mov Disord. 1997;12(1):24–32.
Robert G, Drapier D, Verin M, Millet B, Azulay J, Blin O. Cognitive impulsivity in Parkinson’s disease Patients : assessment and pathophysiology. Mov Disord. 2009;24(16):2316–27. https://doi.org/10.1002/mds.22836.
Scharoun SM, Bryden PJ, Sage MD, Almeida QJ, Roy EA. The Influence of Parkinson's Disease Motor Symptom Asymmetry on Hand Performance: An Examination of the Grooved Pegboard Task. Parkinsons Dis. 2015;2015:307474. https://doi.org/10.1155/2015/307474. Epub 2015 Nov 26. PMID: 26693383
Schneider JS, Sendek S, Yang C. Relationship between motor symptoms, cognition, and demographic characteristics in treated mild/moderate Parkinson’s disease. PLoS One. 2015;10(4):1–11. https://doi.org/10.1371/journal.pone.0123231.
Scott SH. Apparatus for measuring and perturbing shoulder and elbow joint positions and torques during reaching. J Neurosci Methods. 1999;89(2):119-27. PMID:10491942
Scott SH, Dukelow SP. Potential of robots as next-generation technology for clinical assessment of neurological disorders and upper-limb therapy. Journal of rehabilitation Research and Development. 48(4):335-54. (PDF, 529 KB). 2011. https://doi.org/10.1682/JRRD.2010.04.0057 PMID: 21674387.
Semrau JA, Herter TM, Scott SH, Dukelow SP. Recovery after stroke with robotics; 2015. https://doi.org/10.1161/STROKEAHA.115.010750.
Sepehri B, Esteki A, Ebrahimi-Takamjani E, Shahidi GA, Khamseh F, Moinodin M. Quantification of rigidity in Parkinson’s disease. Ann Biomed Eng. 2007;35(12):2196–203. https://doi.org/10.1007/s10439-007-9379-6.
Simmatis L, Krett J, Scott SH, Jin AY. Robotic exoskeleton assessment of transient ischemic attack. PLoS One. 2017;12(12):e0188786. https://doi.org/10.1371/journal.pone.0188786 eCollection 2017. PMID: 29272289.
Tyryshkin K, Coderre AM, Glasgow JI, Herter TM, Bagg SD, Dukelow SP, Scott SH. A robotic object hitting task to quantify sensorimotor impairments in participants with stroke. J NeuroEng Rehabil. 2014;11(1):1–12. https://doi.org/10.1186/1743-0003-11-47.
Weintraub D. Dopamine and impulse control Disorders in Parkinson’s disease. Ann Neurol. 2008;64:S93–100. https://doi.org/10.1002/ana.21454.
Wiratman W, Kobayashi S, Chang FY, Asano K, Ugawa Y. Assessment of cognitive and motor skills in Parkinson's disease by a robotic object hitting game. Front Neurol. 2019;10:19. https://doi.org/10.3389/fneur.2019.00019 eCollection 2019. PMID: 30745892.
Wolfson AM, Doctor JN, Burns SP. Clinician judgments of functional Outcomes : how Bias and perceived accuracy affect rating; 2000. https://doi.org/10.1053/apmr.2000.16345.
We wish to thank Kim Moore, Simone Appaqag, Justin Peterson, and Helen Bretzke for their technical assistance.
This work was funded by an Academic Health Science Centre Alternative Funding Plan Innovation Fund Award (SEA-14-005). The funding body did not take part in the collection, analysis and interpretation of the data and writing the manuscript.
Ethics approval and consent to participate
We confirm that any aspect of recruitment and data collection/analysis of human participants has been conducted with the ethnical approval of each individual. Ethical approval of this study was obtained by the Kingston General Hospital Research Institute ethics board. All approvals are acknowledged within the manuscript.
Consent for publication
We confirm that inform consent was obtained from each participant prior to the start of the study. Each individual consented to the publication of the collected clinical and robotic data.
We wish to consider a known conflict of interest associated with SHS who is the co-founder and chief science officer of BKIN technologies which commercializes the KINARM robotic device. His spouse is an employee of BKIN technologies.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Comparison of rigidity parameters (start/end total torques, hold torque, and peak speeds) derived from the passive stretch task performed over 600 ms and 1500 ms. A greater number of rigidity parameters were abnormal (i.e. failed in comparison to healthy subject performance) when faster stretches (600 ms) were used.
About this article
Cite this article
Gaprielian, P., Scott, S.H., Lowrey, C. et al. Integrated robotics platform with haptic control differentiates subjects with Parkinson’s disease from controls and quantifies the motor effects of levodopa. J NeuroEngineering Rehabil 16, 124 (2019). https://doi.org/10.1186/s12984-019-0598-5
- Robotic assessment
- Parkinson’s disease
- Dopamine replacement therapy