Skip to main content

Efficacy of a technology-based client-centred training system in neurological rehabilitation: a randomised controlled trial

Abstract

Background

A client-centred task-oriented approach has advantages towards motivation and adherence to therapy in neurorehabilitation, but it is costly to integrate in practice. An intelligent Activity-based Client-centred Training (i-ACT), a low-cost Kinect-based system, was developed which integrates a client-centred and task-oriented approach. The objectives were (1) to investigate the effect of additional i-ACT training on functioning. And (2) to assess whether training with i-ACT resulted in more goal oriented training.

Methods

A single-blind randomised controlled trial was performed in 4 Belgian rehabilitation centres with persons with central nervous system deficits. Participants were randomly allocated through an independent website-based code generator using blocked randomisation (n = 4) to an intervention or control group. The intervention group received conventional care and additional training with i-ACT for 3 × 45 min/week during 6 weeks. The control group received solely conventional care. Functional ability and performance, quality of life (QoL), fatigue, trunk movement, and shoulder active range of motion (AROM) were assessed at baseline, after 3 weeks and 6 weeks of training, and 6 weeks after cessation of training. Data were analysed using non-parametric within and between group analysis.

Results

47 persons were randomised and 45 analysed. Both intervention (n = 25) and control (n = 22) group improved over time on functional ability and performance as measured by the Wolf Motor Function Test, Manual Ability Measure-36, and Canadian Occupational Performance Measure, but no major differences were found between the groups on these primary outcome measures. Regarding QoL, fatigue, trunk movement, and shoulder AROM, no significant between group differences were found. High adherence for i-ACT training was found (i.e. 97.92%) and no adverse events, linked to i-ACT, were reported. In the intervention group the amount of trained personal goals (88%) was much higher than in the control group (46%).

Conclusions

Although additional use of i-ACT did not have a statistically significant added value regarding functional outcome over conventional therapy, additional i-ACT training provides more individualised client-centred therapy, and adherence towards i-ACT training is high. A higher intensity of i-ACT training may increase therapy effects, and should be investigated in future research.

Trial registration: ClinicalTrials.gov Identifier NCT02982811. Registered 29 November 2016.

Background

Rehabilitation in persons with central nervous system (CNS) deficits such as stroke, multiple sclerosis, and spinal cord injury, is important to regain and/or maintain functional ability in activities of daily life (ADLs), and consequently optimise quality of life (QoL) [1,2,3,4,5]. Practice methods that showed promising results regarding motivation and effectiveness in neurorehabilitation, are task-oriented therapy and client-centred training [6,7,8,9,10,11]. Task-oriented training is considered a highly individualised training of functional tasks based on task segmentation [6, 7]. The client-centred approach incorporates the person’s wishes and needs, and actively involves the person with deficits in setting certain goals in their rehabilitation process [7, 9,10,11,12]. By using occupational models and assessments, such as the Person-Environment-Occupation model (PEO-model) [13] and Canadian Occupational Performance Measure (COPM) [14,15,16], therapists can involve the person with deficits in the process of setting unique and individual goals, which increases therapy motivation and consequently adherence. The extra advantage of the COPM is that it cannot only be used for goal setting but also for the assessment of self-perceived occupational performance [14,15,16].

Although motivation is higher when using a task-oriented client-centred approach, in practice this is time-consuming. To increase persons’ motivation and treatment adherence, technology-based systems with immersive or non-immersive virtual reality (VR) or augmented reality (AR) such as Nintendo Wii or Microsoft Kinect, can be used [1, 2, 5, 17,18,19,20]. However, these commercially available, low-cost systems do not incorporate a client-centred task-oriented approach, and the standard (exer)games are not developed to meet the rehabilitation goals such as improving coordination patterns or compensation strategies when performing task-oriented exercises [1, 2, 4, 5, 21]. Although these systems are not developed to meet rehabilitation goals, we explored the skeleton tracking feature of Microsoft Kinect in earlier research and developed an intelligent activity-based client-centred training (i-ACT) system using Microsoft Kinect sensor and software development kit [22]. i-ACT allows persons with CNS deficits to train more explicit on individual goals and the usability of i-ACT and persons’ motivation, credibility and expectancy towards using i-ACT for rehabilitation purposes, was established [23]. Results of that cohort study showed an increase over time regarding upper limb functional ability and perceived performance, but no comparison was made with a control group [24]. The purpose of this trial was to investigate the effect of additional i-ACT training on functional ability, occupational performance, quality of life (QoL), fatigue, trunk movement, and shoulder active range of motion (AROM) compared to conventional therapy alone. Our first hypothesis was that there is a positive effect of additional i-ACT training on functional ability and perceived occupational performance in comparison with conventional therapy. Our secondary hypothesis was that as compared to conventional therapy, there is a positive effect of additional i-ACT training on quality of life, fatigue, trunk impairment and AROM in the shoulder. The third hypothesis was that the individualised goals set by persons with deficits are trained more explicit when exercising with i-ACT compared to conventional therapy.

Methods

Participants and study protocol

Persons with CNS were recruited in four rehabilitation centres in Flanders (Belgium) to participate in a single-blind randomised controlled trial (RCT).

The inclusion criteria were: age over 18 years old, a medical diagnosis of central nervous system disease, and dysfunction in upper limb and/or core stability. Persons with multiple sclerosis (MS) had to be free of treatment with corticosteroids for one month. Persons with stroke or spinal cord injury, had to be at least three months post injury. Exclusion criteria were: severe spasticity (when spasticity impedes movement), severe cognitive impairment (person is not able to understand and follow instructions), severe communicative impairment (person is not able to answer questions), severe visual impairment (person is not able to see the television screen), persons who use an electric wheelchair as the Microsoft Kinect® might have troubles recognising a human skeleton.

Potential participants were recruited by either the rehabilitation physician or therapist based on the person with deficits’ medical files. Information letters about the study and an invitation to participate were provided to the potential participants. Furthermore, an individual meeting was scheduled with these potential participants to provide answers to possible questions or concerns. During this individual meeting, the potential participants were screened by the primary supervisor as to the inclusion and exclusion criteria. After receiving informed consent, the COPM was conducted to collect the participants’ individual goals towards rehabilitation. These goals were discussed with the occupational and/or physiotherapist of the individual participant as to what extend these goals were realistic and relevant, and generally in accordance with the therapeutic goals.

After inclusion, the participants were randomly allocated to either the experimental group (i-ACT training with conventional care) or the control group (conventional care), using blocked randomisation (block size n = 4). The randomisation procedure was performed by an independent researcher (JL) using the website www.sealedenvelope.com/simple-randomiser from which also a unique code per participant was generated. The primary researcher (EK) involved in data collection was blinded for the group allocation.

Outcomes measures were collected by the primary researcher at baseline (T0), after 3 weeks (T1) and 6 weeks (T2) of training, and at 6 weeks follow-up (T3). To provide a stable image of the participant, baseline measures were performed 3 times over 3 weeks.

Participants received 3 × 45 min of training with i-ACT (see Apparatus) during six weeks, additional to conventional care. Exercises in i-ACT were individually set to meet the individual goals of the participants as set by the COPM and discussed with the person’s therapists. Furthermore, exercises were individually set regarding possibilities and progression of each individual participant.

Outcome measures

The following demographic data were obtained from the participant or medical files: age, gender, diagnosis, and time of diagnosis.

The primary outcome measures were the Wolf Motor Function Test (WMFT) [25,26,27], Manual Ability Measure-36 (MAM-36) [25, 26, 28, 29], and Canadian Occupational Performance Measure and COPM [14, 15]. The secondary outcome measures were Short Form-36 (SF-36) [30], Modified Fatigue Impact Scale (MFIS)[31,32,33], Trunk Impairment Scale (TIS)[34,35,36], and Active Range of Motion (AROM) of the shoulder.

The WMFT is a test for arm-hand functioning on International Classification of Functioning, Disability and Health (ICF) level of actual performance (activity level). The WMFT contains 17 items (2 strength-based tasks and 15 function-based tasks) arranged in order of complexity. The strength-based tasks are measured by weight lift and grip strength, while the 15 function-based tasks are timed and scored on a scale from 0 (not able to perform task) to 5 (normal performance) [26, 27, 37]. The MAM-36 is a questionnaire on International Classification of Functioning, Disability and Health (ICF) level of perceived occupational performance (activity level). Questions relate to the ease or difficulty level of how a person is able to perform unilateral and bilateral ADL-tasks. Scores range from 0 (impossible) to 4 (easy) [25, 26, 28, 29]. The COPM is a client-centred individualised instrument on ICF Participation level. This outcome measure is developed to capture a person’s self-perception of performance in ADL, over time. By means of a semi-structured interview, persons are asked to identify their 5 main goals in self-care, productivity and/or leisure. These 5 goals are scored on execution and satisfaction with scores ranging from 0 (negative) to 10 (positive) [15, 16, 38, 39].

Secondary outcome measures were the SF-36 [30], MFIS [31,32,33], TIS [34,35,36], and AROM of the shoulder.

The SF-36 is a 36-item, person-reported survey regarding QoL measures, on all ICF levels (i.e. ICF Function, ICF Activity, and ICF Participation)[40]. The SF-36 consists of 8 categories, i.e. physical functioning, role limitations due to physical health, role limitations due to emotional problems, energy/fatigue, emotional well-being, social functioning, pain, and general health. The higher the score, the more favourable health state is reported [30, 41,42,43,44]. The MFIS is a questionnaire which provides information on how fatigue impacts the life of the person, in terms of physical, cognitive, and psychosocial functioning. Twenty-one items are scored on a 5-point Likert-scale (range from 0 = never to 4 = almost always) [31,32,33]. The MFIS is not specified to one domain of the ICF. The TIS is an assessment to measure motor impairment of the trunk by evaluating 3 aspects: static sitting balance, dynamic sitting balance, and trunk co-ordination. Each item is scored on a 2-, 3- or 4-point scale, ranging from a minimum of 0 to a maximum of 23 points [34,35,36]. The TIS is an assessment in ICF level of actual performance (activity level). The AROM refers to the possible range in motion while performing non-assisted voluntary movement of a body part on ICF function level. In this study, the AROM of the shoulder joint is measured with a goniometer for abduction and flexion in relation to the torso from the neutral anatomical position.

Ethics statement

All study procedures were approved by the Medical Ethics Committee of UZ KU Leuven (Registration number B322201731417) and local Ethics Committees of the participating centres. All participants signed an informed consent prior to participating in the study. The clinical trial was registered as NCT02982811.

Apparatus

i-ACT consists of the Microsoft Kinect® sensor and the Microsoft Kinect® software development kit (SDK). The Microsoft Kinect® detects a human shape and human movements. For the technical development of i-ACT, the cross-platform Unity3D was used. The most important feature of i-ACT is that the client-centred approach is involved in every step, as well as the possibility to work task-oriented. Therapists can record a movement which is valuable for the person with deficits, then can set up the necessary parameters to progress towards an exercise (e.g. amount of repetitions, target placement, etc.) which is unique for this specific participant. Furthermore, one or more stability points can be integrated. A point of stability is a body region (joint) that is marked with a coloured sphere as an area where no movement is allowed beyond a certain bandwidth, i.e. to avoid compensatory movement. The therapists can set the stability point to one or more joints and can also adapt the size of the sphere. The bigger the sphere, the more (compensational) movement is allowed in this joint. When the person with deficits moves out of the sphere, the person receives feedback that the movement is not correct.

The person with deficits is visualised by an avatar in a virtual environment where the person receives real time feedback on successful trajectories and stabilisation of set body areas, i.e. quality of movement (see Fig. 1). A more detailed description of the development of i-ACT is explained in Knippenberg et al. [22].

Fig. 1
figure 1

Person with deficits’ interface during performance of the exercise “drinking from a cup”. The avatar on the left represents the therapist (i.e. recorded movement) while the avatar on the right represents the person with deficits. The green dot is the stability point for restriction of compensational movement. The pink dots are the targets for the right hand

Statistical analysis

If data did not follow a normal distribution pattern, non-parametric statistics were used.

For differences within groups, a Friedman’s ANOVA was performed to assess if significant progress was made over time (baseline T0, after 3 weeks of training T1, after cessation of training T2, and after 6 weeks follow-up T3). The Wilcoxon signed-rank test was performed to assess significant progress over time between baseline and cessation of training (i.e. training period T0-T2), and cessation of training and follow-up (follow-up period T2-T3). Alpha was set at 0.05 and a Bonferroni approach was used. The Bonferroni corrected alpha value equals 0.025 for data comparison between T0-T2 and T2-T3. When significant difference was found in the Wilcoxon signed-rank test, the effect size r was calculated to look at the levels of change according to the Cohen’s benchmarks (i.e. r between 0.3 and 0.5 for a medium effect, and r above 0.5 for a large effect) [45]. Differences between i-ACT intervention group and control group were tested with the Mann–Whitney U test. The data of the persons who dropped out or were lost to follow-up, were treated as missing data and as such analysed using pairwise deletion. By using pairwise deletion, we preserved more information in relation to listwise deletion. Data were analysed using SPSS software (SPSS Inc., Chicago, IL). Differences between intervention group and control group regarding distribution of trained versus untrained goals was performed using descriptive analysis using Microsoft Excel (2016).

Results

Figure 2 represents a flow chart of the study. A total of 47 persons were allocated using a block randomisation per centre per 4 participants. Forty-five persons completed the training period and 37 persons completed the full protocol. As 80% of the participants were diagnosed with stroke (36 out of 45), the same statistical post hoc analyses were performed for persons with stroke, to look into possible differences between the general group (i.e. all diagnoses included, n = 45) and stroke group (i.e. persons with stroke, n = 36). Two persons dropped out during the training period due to discharge from the hospital. The inclusion of participants started in March 2017 and lasted until May 2020.

Fig. 2
figure 2

Flow chart (CONSORT). T0 Baseline, T1 after 3 weeks of training, T2 test moment after 6 weeks of training, T3 test moment 6 weeks after cessation of training

Participants characteristics

Participants characteristics are shown in Table 1. In total, 45 participants were included for the analyses of which 27 male and 18 female persons with CNS disease, with a mean age of 59.07 ± 16.42. Twenty-one participants of which 11 males and 10 females, were allocated in the control group, mean age 60.14 ± 16.72. In the intervention group, 24 participants were allocated of which 16 males and 8 females, with a mean age of 58.13 ± 16.46. The difference in number of the allocated participants between control (n = 21) and intervention group (n = 24) is due to the use of block randomisation (n = 4) by participating rehabilitation centre (n = 4). All baseline characteristics and outcome measures deviated from normal distribution for both control group and intervention group, except for age (p = 0.053 and 0.656 respectively). Regarding primary outcome measures at baseline, only a significant difference between intervention and control group was found in MAM-36 (p = 0.036) and COPM-satisfaction (p = 0.036). Compliance of participants with attending the intervention sessions was 97.92%. Two participants missed 9 sessions of which 6 sessions were missed due to doctor appointments / hospital visits, 3 sessions were missed due to external family-related activities (i.e. family birthday party). No adverse effects of the intervention were found.

Table 1 Participants characteristics

Outcome measures

An overview of the test results can be found in Table 2. The mean delta scores (i.e. cessation of training values minus baseline values and follow-up values minus cessation of training values) are represented in Table 3.

Table 2 Results on outcome measures
Table 3 Median (interquartile range) delta scores during training period and follow-up period with between group difference

Within group differences

Significant differences (p < 0.05) within intervention and control group were found over the total time in all the primary outcome measures, i.e. WMFT, MAM-36 and COPM. Furthermore, significant differences (p < 0.05) within both groups over time were also found in TIS and AROM-flexion. Within the intervention group, a significant difference (p < 0.05) over time was found in AROM-abduction, while in the control group, a significant difference (p < 0.05) over time was found in SF-36 subscale emotional well-being. No significant differences were found in either group for MFIS.

When examining the specific period of training period (T0-T2) and follow-up (T2-T3), the significant differences are, as expected, mainly found in the training period, as seen in Table 2. Regarding the training period (T0-T2), significant improvement was found in the intervention group in all primary outcome measures, i.e. WMFT-FAS (p = 0.000), WMFT-Time (p = 0.003), MAM-36 (p = 0.000), COPM-performance (p = 0.001), and COPM-satisfaction (p = 0.002), and secondary outcome measures TIS (p = 0.000), AROM-abduction (p = 0.014), and AROM-flexion (p = 0.011). In the control group, significant improvement was found in 2 out of 3 primary outcome measures, i.e. WMFT-FAS (p = 0.000), WMFT-Time (p = 0.004), COPM-performance (p = 0.008), and COPM-satisfaction (p = 0.005), and in 1 secondary outcome measure (TIS with p = 0.002).

Examining the follow-up period (T2-T3), significant improvement is found in the intervention group for WMFT-FAS (p = 0.000), WMFT-Time (p = 0.002), and AROM-abduction (p = 0.025). In the control group, significant improvement is found during the same period in MAM-36 (p = 0.016), COPM-performance (p = 0.011), and AROM-flexion (p = 0.006).

No significant differences in training period as well as follow-up period were found in SF-36 and MFIS in both intervention or control group.

Between group differences

An overview of the delta scores between baseline and cessation of training (T2), and cessation of training (T2) and follow-up (T3) can be found in Table 3. With regard to the primary outcomes, only a significant improvement was found for MAM-36 in training period in favour of intervention group (p = 0.000 with r = 0.561). For the follow-up period, this significant improvement was in favour of the control group (p = 0.031 with r = -0.358). Regarding the secondary outcome measures, only a significant improvement in favour of the intervention group was found in SF-36 energy/fatigue subscale for the follow-up period (p = 0.042, r = 0.340).

Individual goal setting

Although the expectation was that a significant difference would occur between intervention and control group with regards to COPM, no significant difference was found. Therefore, a distribution of untrained versus trained goals was performed. An overview of the distribution of untrained versus trained goals in both control and intervention group can be found in Table 4. In general, in the control group, the distribution of untrained versus trained is about the same (i.e. 50%). While in the intervention group, it is clear that more than 85% of the participants’ chosen goals, were implemented in the therapy as usual together with the additional therapy with i-ACT.

Table 4 Percentages of untrained versus trained COPM goals

Post hoc analyses

As the majority of participants were persons with stroke, a post hoc analyses was performed for persons with stroke. An overview of the test results is presented in Table 5.

Table 5 Results on outcome measures from post hoc analyses in persons with stroke

The stroke group (n = 36) consisted of 24 male and 12 female persons with stroke, with a mean age of 62.06 ± 15.05. Seventeen participants were allocated to the control group (10 male and 7 female participants, mean age 62.59 ± 15.58), while 19 persons were allocated in the intervention group (14 male and 5 female participants, mean age 61.58 ± 14.97). In the stroke group, no significant differences were found in the baseline characteristics and primary outcome measures between control group and intervention group.

Regarding within group differences, similar results were found in the stroke group compared to the general group, with the exception of AROM-flexion, as no significant difference was found in the control group.

When examining the specific period of training (T0-T2) and follow-up (T2-T3), similar results were found in the stroke group as opposed to the general group during training period. The results within the stroke intervention group are similar to the results in the intervention group of the general group; All outcome measures that showed significant improvement in the general intervention group, also show significant improvement in the stroke intervention group. As for the stroke control group, the same outcome measures showed significant improvement except for the COPM-performance, which did not show significant improvement (p = 0.052) compared to the general control group. Looking into the follow-up period, similar results are found for the stroke intervention group compared to the general intervention group, with the exception of AROM-abduction where no significant improvement is found (p = 0.064). The control group of the stroke group is not very similar to the general group. For the stroke control group, significant improvement is found for the MAM-36 (p = 0.008) and AROM-flexion (p = 0.013), but significant deterioration was found for WMFT-Time (p = 0.025) as the performance time was higher at follow-up. Also similar to the general group is that no significant differences in training period as well as follow-up period were found in SF-36 and MFIS in both intervention or control group.

Regarding the between group difference, similar results were found for the stroke group as also a significant improvement was found in MAM-36 in favour of the intervention group during training period (p = 0.000, r = 0.591) and in favour of the control group during the follow-up period (p = 0.019, r = − 0.373). Regarding the secondary outcome measures, significant improvement was found in favour of the intervention group in TIS (p = 0.011, r = 0.421) during training period.

Discussion

The aim of this study was to investigate whether the use of i-ACT as an additional tool has an effect on functional ability and performance, quality of life (QoL), fatigue, trunk movement, and shoulder active range of motion (AROM).

No major differences were found between the intervention group and control group on any of the outcome measures for both the general group as well as the stroke group. Both the intervention and control groups improved over time on the primary outcome measures (i.e. WMFT, MAM-36, and COPM). This is in concordance with other studies that used virtual reality, exergames, or robot-assisted therapy, who found similar results – i.e. they did not find significant differences on functional ability between intervention group and control group [8, 46,47,48]. But studies showed an increase in motivation when using virtual reality of games [1, 48, 49] and also suggest that the use of virtual reality or virtual games may be beneficial in improving ADL when provided as additional training [46]. As seen in the results, we found significant differences between baseline and cessation of training, but not as much as between cessation of training and follow-up. Whether this suggests that additional therapy with i-ACT has, although small, a positive influence on the functional and occupational performance of persons with deficits, needs to be further investigated.

We expected a significant difference regarding the COPM results, but no significant differences between intervention and control group were found. On the one hand the COPM results in the intervention groups were already high at baseline, but there was still an increase during the training period. On the other hand the variance was large in both intervention and control groups. We did find a clear distinction between the intervention group and control group regarding the amount of trained personal goals. Although conventional therapy also focusses on providing a client-centred approach, our results suggest that i-ACT can support a client-centred approach as about 88% of the persons’ goals were implemented in i-ACT training compared to about 46% in control group during conventional therapy. This finding confirmed our third hypothesis as i-ACT is specifically developed to incorporate a client-centred approach by being able to record and set different kinds of activities (which are determined by the person with deficits), and provide individualised real-time feedback regarding the performance of the person with deficits [13]. These features distinguish i-ACT from other Kinect-based systems which mostly use commercially available (exer)games, which are not designed to meet rehabilitation goals such as feedback on compensation strategies, coordination patters, etc. [1, 2, 4, 5, 21, 22]. Using the COPM or other goal setting tools that focus on person’s goals and involvement are important aspects of client-centred therapy and increases therapy motivation and also adherence [7, 9,10,11,12]. In this study, we found a very high adherence towards i-ACT training despite voluntary participation, i.e. 97.92%, which confirms the results from our cohort study [24]. This percentage might have been even higher because the reasons to miss an i-ACT therapy session were doctor appointments, hospital visits and family-related activities (i.e. family birthday party). Also, participants commented that they liked exercising with the i-ACT and that it gave them a feeling of involvement by explicitly mentioning the goals they provided during the intake with COPM.

Regarding the secondary outcome measures (i.e. QoL measured by SF-36, fatigue measure by MFIS, trunk function measured by TIS, and shoulder AROM), no significant/evident trends were found. For QoL, the reason might be that the intervention was too short to be of influence on the QoL of persons with CNS decifits or the influence was too small to be detected by the used measurement (i.e. SF-36). With regard to shoulder AROM and TIS, these were not the main focus of the intervention but we hypothesised a possible secondary improvement. Although no significant improvement regarding fatigue was found, no increase in fatigue was found either. This outcome suggests that the additional training with i-ACT is very tolerable by persons with CNS deficits.

In this study, the intervention consisted of 3 × 45 min/week of exercises with i-ACT for 6 weeks. The aim was to provide 45 min of extra training. This goal was achieved, but more training time was not possible due to the available time in the different participating centres. Although other studies with similar or slightly higher dosage show the same results, i.e. improvement within groups but no significant difference between intervention and control group [3, 50,51,52], dosage seems an important factor within motor learning and neuroplasticity [53,54,55,56]. Lang et al. (2016) describe the dosage of training as a combination of four aspects, i.e. frequency (sessions per week), duration (time period of intervention), amount of practice (by number of repetitions or minutes of active therapy), and level of difficulty [53]. Although Lang et al. (2016) found no significant dose–response effect [53], other evidence still suggests that higher dosage is better [57,58,59,60,61]. Taking this into account, the dosage in our study was probably too low to find significant differences and we recommend performing an intervention with a higher dosage of therapy. The most common dosage would be at least one hour/session, 5d/week, 4–6 weeks as based on the meta-analysis by Saposnik et al. (2011), which found 11 of 12 studies showing significant improvement toward virtual reality therapy for selected outcomes such as WMFT [4]. We did not find increased fatigue, as measured by MFIS, based on the current intensity. Therefore, there are no contraindications to increase dosage. Future research should be performed with increased intensity to investigate the benefits of increased training with i-ACT on functional ability and performance, but also towards neuroplastic changes.

By taking into account the four aspects of dosage by Lang et al. [53], the i-ACT can provide an added value to register the dosage of training with i-ACT as it registers number of sessions (i.e. frequency), total training time (i.e. duration and frequency), exercise time (i.e. amount of practice), amount of repetitions (amount of practice), number of targets reached (from which a therapist can derive the level of difficulty), and the percentage of compensational movements (from which a therapist can derive the level of difficulty). i-ACT also has the potential to increase therapy dosage without major financial burden and negative side events as no adverse events or increase of fatigue were reported towards the additional use of i-ACT, no interference of additional i-ACT training to conventional care is found, and i-ACT is considered a low-cost system [24]. Also, during the COVID-19 pandemic, a secured online platform is developed so all results can be consulted by therapists from a distance which creates opportunities for the independent use of i-ACT in rehabilitation or even implementation in the person’s home environment.

This study may have suffered from insufficient power which might have contributed to the lack of significance between groups. Furthermore, missing data occurred in the follow-up data and therefore conclusions based on the follow-up period (T2-T3) have even less power and must be treated with caution.

Other studies with rehabilitation technology in neurorehabilitation, have similar numbers of participants [1, 8, 48, 52, 62,63,64,65]. Furthermore, the sample consisted of a very diverse population to generalise towards a broader spectrum within neurorehabilitation, but mainly persons with stroke. A comparison of stroke versus general group, and stroke versus other CNS deficits was performed but similar results were found between the general group and stroke group as well as the stroke group versus other CNS deficits. Considering the similar results, there is no reason to expect that i-ACT does not work within all these different groups. But certainty is only guaranteed when research is performed in separate target groups. Future research could also assess implications of additional i-ACT training on participation level, preferably linked with the provided COPM goals, with a long term monitoring.

Conclusions

Upper limb functional ability and perceived performance on ADL improved after 6 weeks of training, in both the i-ACT intervention group and control group. Although the use of i-ACT did not seem to have a significant added value with regards to functional outcome over conventional therapy, i-ACT may provide opportunities for therapists to supply persons with deficits with additional client-centred task-oriented therapy with individualised performance feedback. For this purpose, the dosage of therapy with i-ACT needs to be increased in future research and therapy.

Availability of data and materials

The datasets generated and analysed during are available from the corresponding author on reasonable request.

References

  1. Knippenberg E, Verbrugghe J, Lamers I, Palmaers S, Timmermans A, Spooren A. Markerless motion capture systems as training device in neurological rehabilitation: a systematic review of their use, application, target population and efficacy. J Neuroeng Rehabil. 2017;14(1):61.

    PubMed  PubMed Central  Google Scholar 

  2. Brokaw EB, Eckel E, Brewer BR. Usability evaluation of a kinematics focused Kinect therapy program for individuals with stroke. THC. 2015;23(2):143–51.

    Google Scholar 

  3. Levin MF, Snir O, Liebermann DG, Weingarden H, Weiss PL. Virtual reality versus conventional treatment of reaching ability in chronic stroke: clinical feasibility study. Neurol Ther. 2012;1(1):1–15.

    Google Scholar 

  4. Saposnik G, Levin M, Outcome Research Canada Working G. Virtual reality in stroke rehabilitation: a meta-analysis and implications for clinicians. Stroke. 2011;42(5):1380–6.

    PubMed  Google Scholar 

  5. Sin H, Lee G. Additional virtual reality training using Xbox Kinect in stroke survivors with hemiplegia. Am J Phys Med Rehabil. 2013;92(10):871–80.

    PubMed  Google Scholar 

  6. Almhdawi KA, Mathiowetz VG, White M, delMas RC. Efficacy of occupational therapy task-oriented approach in upper extremity post-stroke rehabilitation. Occup Ther Int. 2016;23(4):444–56.

    PubMed  Google Scholar 

  7. Spooren AI, Janssen-Potten YJ, Kerckhofs E, Bongers HM, Seelen HA. Evaluation of a task-oriented client-centered upper extremity skilled performance training module in persons with tetraplegia. Spinal Cord. 2011;49(10):1049–54.

    CAS  PubMed  Google Scholar 

  8. Timmermans AA, Lemmens RJ, Monfrance M, Geers RP, Bakx W, Smeets RJ, et al. Effects of task-oriented robot training on arm function, activity, and quality of life in chronic stroke patients: a randomized controlled trial. J Neuroeng Rehabil. 2014;11:45.

    PubMed  PubMed Central  Google Scholar 

  9. Cott CA. Client-centred rehabilitation: client perspectives. Disabil Rehabil. 2004;26(24):1411–22.

    PubMed  Google Scholar 

  10. Siegert RJ, Taylor WJ. Theoretical aspects of goal-setting and motivation in rehabilitation. Disabil Rehabil. 2004;26(1):1–8.

    PubMed  Google Scholar 

  11. Wressle E, Eeg-Olofsson AM, Marcusson J, Henriksson C. Improved client participation in the rehabilitation process using a client-centred goal formulation structure. J Rehabil Med. 2002;34(1):5–11.

    PubMed  Google Scholar 

  12. Donnelly C, Eng JJ, Hall J, Alford L, Giachino R, Norton K, et al. Client-centred assessment and the identification of meaningful treatment goals for individuals with a spinal cord injury. Spinal Cord. 2004;42(5):302–7.

    CAS  PubMed  PubMed Central  Google Scholar 

  13. Strong S, Rigby P, Stewart D, Law M, Letts L, Cooper B. Application of the Person-Environment-Occupation Model: a practical tool. Can J Occup Ther. 1999;66(3):122–33.

    CAS  PubMed  Google Scholar 

  14. Canadian Association of Occupational Therapists. Enabling occupation: an occupational therapy perspective. Rev Ed ed: CAOT; 2002 01/01/2002.

  15. Carswell A, McColl MA, Baptiste S, Law M, Polatajko H, Pollock N. The Canadian Occupational Performance Measure: a research and clinical literature review. Can J Occup Ther. 2004;71(4):210–22.

    PubMed  Google Scholar 

  16. Bodiam C. The use of the Canadian Occupational Performance Measure for the assessment of outcome on a neurorehabilitation unit. Br J Occup Ther. 1999;62(3):123–6.

    Google Scholar 

  17. Paquin K, Crawley J, Harris JE, Horton S. Survivors of chronic stroke–participant evaluations of commercial gaming for rehabilitation. Disabil Rehabil. 2016;38(21):2144–52.

    PubMed  Google Scholar 

  18. Webster D, Celik O. Systematic review of Kinect applications in elderly care and stroke rehabilitation. J Neuroeng Rehabil. 2014;11:108.

    PubMed  PubMed Central  Google Scholar 

  19. Lozano-Quilis JA, Gil-Gomez H, Gil-Gomez JA, Albiol-Perez S, Palacios-Navarro G, Fardoun HM, et al. Virtual rehabilitation for multiple sclerosis using a kinect-based system: randomized controlled trial. JMIR Serious Games. 2014;2(2):e12.

    PubMed  PubMed Central  Google Scholar 

  20. Llorens R, Noe E, Colomer C, Alcaniz M. Effectiveness, usability, and cost-benefit of a virtual reality-based telerehabilitation program for balance recovery after stroke: a randomized controlled trial. Arch Phys Med Rehabil. 2015;96(3):418-25.e2.

    PubMed  Google Scholar 

  21. Gamito P, Oliveira J, Coelho C, Morais D, Lopes P, Pacheco J, et al. Cognitive training on stroke patients via virtual reality-based serious games. Disabil Rehabil. 2017;39(4):385–8.

    PubMed  Google Scholar 

  22. Knippenberg E, Van Hout L, Smeets W, Palmaers S, Timmermans A, Spooren A. Developing an intelligent activity-based client-centred training system with a user-centred approach. THC. 2020;28(4):355–68.

    Google Scholar 

  23. Knippenberg E, Lamers I, Timmermans A, Spooren A. Motivation, usability, and credibility of an intelligent activity-based client-centred training system to improve functional performance in neurological rehabilitation: an exploratory cohort study. IJERPH. 2021;18(14):7641.

    PubMed  PubMed Central  Google Scholar 

  24. Knippenberg E, Lamers I, Smeets W, Timmermans A, Spooren A. Motivation, usability and functionality of an intelligent activity-based client-centred training system in neurological rehabilitation: an exploratory cohort study. IJERPH. 2021. https://doi.org/10.3390/ijerph18147641.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Lamers I, Feys P. Assessing upper limb function in multiple sclerosis. Mult Scler. 2014;20(7):775–84.

    PubMed  Google Scholar 

  26. Lamers I, Kelchtermans S, Baert I, Feys P. Upper limb assessment in multiple sclerosis: a systematic review of outcome measures and their psychometric properties. Arch Phys Med Rehabil. 2014;95(6):1184–200.

    PubMed  Google Scholar 

  27. Ng AKY, Leung DPK, Fong KNK. Clinical utility of the action research arm test, the wolf motor function test and the motor activity log for hemiparetic upper extremity functions after stroke: a pilot study. Hong Kong J Occup Ther. 2008;18(1):20–7.

    Google Scholar 

  28. Chen CC, Bode RK. Psychometric validation of the Manual Ability Measure-36 (MAM-36) in patients with neurologic and musculoskeletal disorders. Arch Phys Med Rehabil. 2010;91(3):414–20.

    PubMed  Google Scholar 

  29. Lamers I, Cattaneo D, Chen CC, Bertoni R, Van Wijmeersch B, Feys P. Associations of upper limb disability measures on different levels of the International Classification of Functioning, Disability and Health in people with multiple sclerosis. Phys Ther. 2015;95(1):65–75.

    PubMed  Google Scholar 

  30. Aaronson NK, Muller M, Cohen PD, Essink-Bot ML, Fekkes M, Sanderman R, et al. Translation, validation, and norming of the Dutch language version of the SF-36 Health Survey in community and chronic disease populations. J Clin Epidemiol. 1998;51(11):1055–68.

    CAS  PubMed  Google Scholar 

  31. Kos D, Kerckhofs E, Carrea I, Verza R, Ramos M, Jansa J. Evaluation of the Modified Fatigue Impact Scale in four different European countries. Mult Scler. 2005;11(1):76–80.

    CAS  PubMed  Google Scholar 

  32. Kos D, Kerckhofs E, Nagels G, D’Hooghe BD, Duquet W, Duportail M, et al. Assessing fatigue in multiple sclerosis: Dutch modified fatigue impact scale. Acta Neurol Belg. 2003;103(4):185–91.

    PubMed  Google Scholar 

  33. Mills RJ, Young CA, Pallant JF, Tennant A. Rasch analysis of the Modified Fatigue Impact Scale (MFIS) in multiple sclerosis. J Neurol Neurosurg Psychiatry. 2010;81(9):1049–51.

    CAS  PubMed  Google Scholar 

  34. Verheyden G, Hughes J, Jelsma J, Nieuwboer A, De Weerdt W. Assesing motor impairment of the trunk in patients with traumatic brain injury: reliability and validity of the trunk impairment scale. S Afr J Physiother. 2006;62(2):23–7.

    Google Scholar 

  35. Verheyden G, Nieuwboer A, Mertin J, Preger R, Kiekens C, De Weerdt W. The Trunk Impairment Scale: a new tool to measure motor impairment of the trunk after stroke. Clin Rehabil. 2004;18(3):326–34.

    CAS  PubMed  Google Scholar 

  36. Verheyden G, Vereeck L, Truijen S, Troch M, Herregodts I, Lafosse C, et al. Trunk performance after stroke and the relationship with balance, gait and functional ability. Clin Rehabil. 2006;20(5):451–8.

    PubMed  Google Scholar 

  37. Wolf SL, Catlin PA, Ellis M, Archer AL, Morgan B, Piacentino A. Assessing Wolf Motor function Test as outcome measure for research in patients after stroke. Stroke. 2001;32(7):1635–9.

    CAS  PubMed  Google Scholar 

  38. Chan CC, Lee T. Validity of the Canadian occupational performance measure. Occup Ther Int. 1997;4(3):231–49.

    Google Scholar 

  39. Phipps S, Richardson P. Occupational therapy outcomes for clients with traumatic brain injury and stroke using the Canadian occupational performance measure. Am J Occup Ther. 2007;61(3):328–34.

    PubMed  Google Scholar 

  40. AbilityLab RIoCdbaSR. Medical outcomes study short form 36 Chicago: AbilityLab; 2021. https://www.sralab.org/rehabilitation-measures/medical-outcomes-study-short-form-36. Accessed Jan 2016.

  41. Hays RD, Sherbourne CD, Mazel RM. The RAND 36-item health survey 10. Health Econ. 1993;2(3):217–27.

    CAS  PubMed  Google Scholar 

  42. RAND coorperation. 36-item short form survey (sf-36) scoring instructions: RAND health care; https://www.rand.org/health-care/surveys_tools/mos/36-item-short-form/scoring.html. Accessed Feb 2016.

  43. van der Zee KIS, R. Het meten van de algemene gezondheidstoestand met de RAND-36. Een handleiding. Groningen: Noordelijk Centrum voor Gezondheidsvraagstukken. Rijksuniversiteit Groningen; 1993. 28 p.

  44. Ware JE Jr, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30(6):473–83.

    Google Scholar 

  45. Field A. Discovering statistics using IBM SPSS statistics. 4th ed. New York: SAGE; 2013.

    Google Scholar 

  46. Laver KE, Lange B, George S, Deutsch JE, Saposnik G, Crotty M. Virtual reality for stroke rehabilitation. Cochrane Database Syst Rev. 2017. https://doi.org/10.1002/14651858.CD008349.pub4.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Kim WS, Cho S, Park SH, Lee JY, Kwon S, Paik NJ. A low cost kinect-based virtual rehabilitation system for inpatient rehabilitation of the upper limb in patients with subacute stroke: a randomized, double-blind, sham-controlled pilot trial. Medicine (Baltimore). 2018;97(25):e11173.

    Google Scholar 

  48. Feys P, Coninx K, Kerkhofs L, De Weyer T, Truyens V, Maris A, et al. Robot-supported upper limb training in a virtual learning environment : a pilot randomized controlled trial in persons with MS. J Neuroeng Rehabil. 2015;12:60.

    PubMed  PubMed Central  Google Scholar 

  49. Bonnechere B, Jansen B, Omelina L, Van Sint JS. The use of commercial video games in rehabilitation: a systematic review. Int J Rehabil Res. 2016;39(4):277–90.

    PubMed  Google Scholar 

  50. Lee G. Effects of training using video games on the muscle strength, muscle tone, and activities of daily living of chronic stroke patients. J Phys Ther Sci. 2013;25(5):595–7.

    PubMed  PubMed Central  Google Scholar 

  51. Saposnik G, Cohen LG, Mamdani M, Pooyania S, Ploughman M, Cheung D, et al. Efficacy and safety of non-immersive virtual reality exercising in stroke rehabilitation (EVREST): a randomised, multicentre, single-blind, controlled trial. Lancet Neurol. 2016;15(10):1019–27.

    PubMed  PubMed Central  Google Scholar 

  52. Şimşek TT, Çekok K. The effects of Nintendo WiiTM-based balance and upper extremity training on activities of daily living and quality of life in patients with sub-acute stroke: a randomized controlled study. Int J Neurosci. 2016;126(12):1061–70.

    PubMed  Google Scholar 

  53. Lang CE, Strube MJ, Bland MD, Waddell KJ, Cherry-Allen KM, Nudo RJ, et al. Dose response of task-specific upper limb training in people at least 6 months poststroke: a phase II, single-blind, randomized, controlled trial. Ann Neurol. 2016;80(3):342–54.

    PubMed  PubMed Central  Google Scholar 

  54. Kwakkel G, van Peppen R, Wagenaar RC, Wood Dauphinee S, Richards C, Ashburn A, et al. Effects of augmented exercise therapy time after stroke: a meta-analysis. Stroke. 2004;35(11):2529–39.

    PubMed  Google Scholar 

  55. Van Peppen RP, Kwakkel G, Wood-Dauphinee S, Hendriks HJ, Van der Wees PJ, Dekker J. The impact of physical therapy on functional outcomes after stroke: what’s the evidence? Clin Rehabil. 2004;18(8):833–62.

    PubMed  Google Scholar 

  56. Birkenmeier RL, Prager EM, Lang CE. Translating animal doses of task-specific training to people with chronic stroke in 1-hour therapy sessions: a proof-of-concept study. Neurorehabil Neural Repair. 2010;24(7):620–35.

    PubMed  PubMed Central  Google Scholar 

  57. Lang CE, Lohse KR, Birkenmeier RL. Dose and timing in neurorehabilitation: prescribing motor therapy after stroke. Curr Opin Neurol. 2015;28(6):549–55.

    PubMed  PubMed Central  Google Scholar 

  58. Lohse KR, Lang CE, Boyd LA. Is more better? Using metadata to explore dose-response relationships in stroke rehabilitation. Stroke. 2014;45(7):2053–8.

    PubMed  PubMed Central  Google Scholar 

  59. Hsu SS, Hu MH, Wang YH, Yip PK, Chiu JW, Hsieh CL. Dose-response relation between neuromuscular electrical stimulation and upper-extremity function in patients with stroke. Stroke. 2010;41(4):821–4.

    PubMed  Google Scholar 

  60. Lamers I, Raats J, Spaas J, Meuleman M, Kerkhofs L, Schouteden S, et al. Intensity-dependent clinical effects of an individualized technology-supported task-oriented upper limb training program in Multiple Sclerosis: A pilot randomized controlled trial. Mult Scler Relat Disord. 2019;34:119–27.

    PubMed  Google Scholar 

  61. Waddell KJ, Birkenmeier RL, Moore JL, Hornby TG, Lang CE. Feasibility of high-repetition, task-specific training for individuals with upper-extremity paresis. Am J Occup Ther. 2014;68(4):444–53.

    PubMed  PubMed Central  Google Scholar 

  62. Park DS, Lee DG, Lee K, Lee G. Effects of virtual reality training using xbox kinect on motor function in stroke survivors: a preliminary study. J Stroke Cerebrovasc Dis. 2017;26(10):2313–9.

    PubMed  Google Scholar 

  63. Dos Santos LRA, Carregosa AA, Masruha MR, Dos Santos PA, Coêlho MLDS, Ferraz DD, et al. The use of Nintendo Wii in the rehabilitation of poststroke patients: a systematic review. J Stroke Cerebrovasc Dis. 2015;24(10):2298–305.

    PubMed  Google Scholar 

  64. Jonsdottir J, Bertoni R, Lawo M, Montesano A, Bowman T, Gabrielli S. Serious games for arm rehabilitation of persons with multiple sclerosis. A randomized controlled pilot study. Mult Scler Relat Disord. 2018;19:25–9.

    PubMed  Google Scholar 

  65. Saposnik G, Teasell R, Mamdani M, Hall J, McIlroy W, Cheung D, et al. Effectiveness of virtual reality using wii gaming technology in stroke rehabilitation a pilot randomized clinical trial and proof of principle. Stroke. 2010;41(7):1477–84.

    PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors want to thank all participants of this study, persons with deficits as well as therapists. They also thank Wout Smeets, Ilse Lamers, Olga Gromova, Rayhana Hilami, Axelle Housen, Bjorn Le Roy, Eef Merken, Alexander Oweibo, Céline Peeters, Andrea Prezzi, Stéphanie Stroobants, and Lies Vanweerts for their contribution.

Funding

This study, as part of the i2-CoRT project (www.i2-CoRT.eu), has been co-financed with a grant from the Interreg V-A Euregio Meuse-Rhine (EMR) programme, as well as funding from Provincie Limburg (Belgium) and Vlaams Agentschap Innoveren en Ondernemen (Belgium). The Interreg EMR program has invested almost EUR 100 million in the development of the Interreg-region until 2020. With the investment of EU funds in Interreg projects, the European Union directly invests in the economic development, innovation, territorial development and social inclusion and education of this region.

Author information

Authors and Affiliations

Authors

Contributions

AS, AT, and EK participated in the conception and design of the study. JC, KN, PH, and MM contributed to persons with deficits recruitment. EK, JL contributed to the data collection. AT, AS, EK have been involved in data analysis, data interpretation and drafting and writing of the manuscript. All authors have proofread the manuscript and agree with the final manuscript version.

Corresponding author

Correspondence to Els Knippenberg.

Ethics declarations

Ethics approval and consent to participate

This study was performed in accordance with the Declaration of Helsinki and approved by the Medical Ethics Committee of UZ KU Leuven (Registration number B322201731417) and local Ethics Committees of the participating centres. All subjects provided informed written consent prior to participation.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Knippenberg, E., Timmermans, A., Coolen, J. et al. Efficacy of a technology-based client-centred training system in neurological rehabilitation: a randomised controlled trial. J NeuroEngineering Rehabil 18, 184 (2021). https://doi.org/10.1186/s12984-021-00977-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12984-021-00977-2

Keywords