Skip to main content

European evidence-based recommendations for clinical assessment of upper limb in neurorehabilitation (CAULIN): data synthesis from systematic reviews, clinical practice guidelines and expert consensus

Abstract

Background

Technology-supported rehabilitation can help alleviate the increasing need for cost-effective rehabilitation of neurological conditions, but use in clinical practice remains limited. Agreement on a core set of reliable, valid and accessible outcome measures to assess rehabilitation outcomes is needed to generate strong evidence about effectiveness of rehabilitation approaches, including technologies. This paper collates and synthesizes a core set from multiple sources; combining existing evidence, clinical practice guidelines and expert consensus into European recommendations for Clinical Assessment of Upper Limb In Neurorehabilitation (CAULIN).

Methods

Data from systematic reviews, clinical practice guidelines and expert consensus (Delphi methodology) were systematically extracted and synthesized using strength of evidence rating criteria, in addition to recommendations on assessment procedures. Three sets were defined: a core set: strong evidence for validity, reliability, responsiveness and clinical utility AND recommended by at least two sources; an extended set: strong evidence OR recommended by at least two sources and a supplementary set: some evidence OR recommended by at least one of the sources.

Results

In total, 12 measures (with primary focus on stroke) were included, encompassing body function and activity level of the International Classification of Functioning and Health. The core set recommended for clinical practice and research: Fugl-Meyer Assessment of Upper Extremity (FMA-UE) and Action Research Arm Test (ARAT); the extended set recommended for clinical practice and/or clinical research: kinematic measures, Box and Block Test (BBT), Chedoke Arm Hand Activity Inventory (CAHAI), Wolf Motor Function Test (WMFT), Nine Hole Peg Test (NHPT) and ABILHAND; the supplementary set recommended for research or specific occasions: Motricity Index (MI); Chedoke-McMaster Stroke Assessment (CMSA), Stroke Rehabilitation Assessment Movement (STREAM), Frenchay Arm Test (FAT), Motor Assessment Scale (MAS) and body-worn movement sensors. Assessments should be conducted at pre-defined regular intervals by trained personnel. Global measures should be applied within 24 h of hospital admission and upper limb specific measures within 1 week.

Conclusions

The CAULIN recommendations for outcome measures and assessment procedures provide a clear, simple, evidence-based three-level structure for upper limb assessment in neurological rehabilitation. Widespread adoption and sustained use will improve quality of clinical practice and facilitate meta-analysis, critical for the advancement of technology-supported neurorehabilitation.

Background

Neurological conditions are a leading cause of disability world-wide. Incidence is rising due to an ageing world population and prevalence is increasing due to growth of the world population, better survival rates and improved long-term care [1]. The result is increasing pressure on the healthcare system globally and frames the need for effective and efficient approaches to enable and maintain access to care.

Recent advances in neurorehabilitation research have resulted in a better understanding of recovery, giving rise to new promising approaches such as increased intensity of practice, early intervention and use of technology. Of those, the use of technology in rehabilitation may help alleviate the pressure on the healthcare system. Moreover, technologies could enable access to rehabilitation throughout the lifespan and has been advocated by the World Health Organisation (WHO) as an investment in human capital that contributes to health, economic and social development [2].

For a successful transfer of therapeutic interventions using rehabilitation technology into clinical practice, evidence of their effectiveness is essential. This is reflected in national strategies and frameworks emphasising the need for informed decision making in healthcare that is research-led and evidence-based. Yet, several national guidelines cite limited research evidence to justify the use of rehabilitation technologies [3,4,5]. Indeed, data on clinical evaluations of interventions in neurological rehabilitation, either conventional or technological, are not easily comparable due to inconsistency in what is actually measured [2], and the measurement tools used. Consequently, there is a paucity of high-quality evidence from systematic reviews and meta-analyses [6].

Agreement on outcome measures (OM) and corresponding procedures for assessment are critical to advancing the field. For new approaches to be used effectively in clinical practice (the right therapy approach with the right patients, at the right time and delivered via the most effective protocols), clinicians need clear assessment guidelines to enable them to make informed decisions. The use of agreed, uniform OM is not only useful in order to compare the effectiveness of different training approaches, but also to identify which patients benefit most from which training approach and dose.

For example, the use of different technologies for task-oriented training of the upper limb was investigated in highly functional chronic stroke patients in two separate clinical trials using a sensor system [7] or a robot system [8]. As both studies used the same OM, results could be combined, showing that training with the inertial sensor system providing feedback on exercise performance was more beneficial for highly functional patients than the robot-guided system [9].

In addition, practical and accurate tools are emerging that can predict recovery, with the potential to significantly improve patient management and reduce costs of health services [10]. Establishing and elaborating clinical prediction models for the upper limb, such as SAFE [11] and PREP2 [12], to facilitate personalisation of patient rehabilitation and discharge planning, can only occur if sufficient good quality objective assessment data is available.

The European Network on Robotics for Neurorehabilitation (European Co-operation in Science and Technology, COST Action TD1006) has developed a set of recommendations for upper limb assessment in neurological conditions, to evaluate both conventional and technology-supported therapy. These European recommendations aim to improve the quality of upper limb neurorehabilitation in clinical practice globally, through the adoption of standardised, agreed protocols for assessment in clinical practice and research. The recommendations will directly support clinical research and facilitate larger scale multi-centre studies, allowing meta-analyses, essential for informing and stimulating investigation of prediction for patient-specific training approaches and more generally advancing understanding of recovery. It will also inform and influence the development of new upper limb neurorehabilitation technologies both as therapies and assessment tools, and assist in the translation of useful technologies into clinical practice.

The present paper collates and synthesizes the recommendations from multiple sources, combining existing evidence, current clinical practice guidelines and expert consensus, into the recommendations for Clinical Assessment of Upper Limb In Neurorehabilitation (CAULIN). The CAULIN recommendations provide evidence-based recommendations for upper limb assessment of patients with neurological conditions before, during and after therapy (either conventional or technology-assisted treatment), including the recommended time frame of applying structured assessment where available.

Methods

Scope and purpose

The CAULIN recommendations were developed within the framework of a European network (COST Action TD1006). This enabled involvement of more than 200 experts and stakeholders from over 24 European countries, with a wide range of backgrounds: physical therapists, occupational therapists, physicians and nurses (all working primarily in neurorehabilitation); clinical researchers from the same or related professions; engineers, technology developers; neurological patients; and other stakeholders such as neurorehabilitation educators and healthcare insurers.

A systematic approach, in correspondence with the Appraisal of Guidelines for Research and Evaluation (AGREE) II methodology [13], addressing particularly the AGREE domains of scope and purpose, stakeholder involvement and rigour of development, was used. Both clinical and technology-generated outcome measures were considered, using an expanded version of the WHO International Classification of Functioning, Disability and Health (ICF) as the structuring model, distinguishing at the activity level between capacity (i.e., maximal ability measured in a controlled setting) and performance (i.e., level of functioning in a person’s current environment), with performance further divided between perceived (subjective experienced by a person) and actual (objectively measured) performance. OM on participation level are not targeted specifically for the CAULIN recommendations, considering that participation OM assess more complex activities and social life situations, which aren’t strongly related to UL functioning [14].

Although the evidence and information on which the recommendations are based focus primarily on stroke, other neurological conditions are addressed as well, including spinal cord injury (SCI), multiple sclerosis (MS), and traumatic brain injury (TBI). The recommendations are primarily targeted at supporting clinicians during clinical decision making, but they are also applicable to all professionals working in neurorehabilitation, including research, to establish uniform methods for reporting clinical outcomes.

Procedure for development of recommendations

A structured approach was applied to generate the recommendations, synthesizing three published sources of evidence: existing scientific literature, clinical practice guidelines and expert consensus (Fig. 1). Scientific evidence was provided by a systematic overview of systematic reviews on upper limb OM in stroke including evaluation of psychometric properties and clinical utility [15]. An extensive survey of existing clinical practice guidelines provided recommendations and clinical evidence on assessment and OM across different neurological conditions [16]. Agreed expert opinions on use of OM for assessment of the upper limb in neurorehabilitation were derived from a Delphi consensus study among the 24 European Union (EU) member countries of the COST Action, involving 60 clinicians, 35 clinical researchers, 77 non-clinical researchers and 35 engineers [17]. Each of these research activities were coordinated and executed by members of the TD1006 COST Action (Working Group 1). These activities took largely place in parallel. With this paper we integrate their outcomes.

Fig. 1
figure 1

Schematic view of synthesis criteria for compiling CAULIN recommendations

The CAULIN recommendations for upper limb assessment in neurorehabilitation include:

  1. (1)

    A recommendation on specific sets of OM on body functions and structures and activity level,

  2. (2)

    A recommendation on assessment procedures specifying when, how and by whom the assessments should be done.

Sources of information

Systematic reviews

The systematic overview of 13 systematic reviews (published between 2004 and 2014) focused on the psychometric properties and clinical utility of upper limb OM in stroke [15]. From 53 different upper limb OM included in the overview, 13 met the standards and criteria set for the validity, reliability, responsiveness and clinical utility. Of those, six OM demonstrated a high level of measurement quality and clinical utility and were recommended for assessment of upper limb function and activity in research and clinical practice. All 13 OM with published evidence of adequate measurement quality (psychometric properties) and clinical utility were considered for the synthesized CAULIN recommendations.

Clinical practice guidelines

The evidence from 34 records (published between 2007 and 2017), including existing national clinical guidelines and published practice guidelines, on assessment of upper limb in neurorehabilitation provided input from clinical practice to the CAULIN recommendations [16]. The specific OM of body function, activity and participation recommended by these clinical practice guidelines for upper limb assessment were considered for the current synthesis.

Expert consensus

A Delphi consensus exercise with six consensus rounds performed between 2011 and 2015 provided evidence from five expert groups, consisting of 208 clinicians and researchers from medical and engineering fields across Europe. In each expert group, votes were collected on questions and statements about the use of OM for upper limb assessment in neurorehabilitation. At least 69% consensus was required for each statement to be included as a recommendation for the current synthesis [17].

Structured data synthesis

Recommended OM sets

Data from all three sources (systematic reviews, clinical practice guidelines, and expert consensus) were systematically extracted and combined to form specific sets of recommended OM (Fig. 1). The extracted data were synthesized across the three sources by rating them, based on the strength of evidence, according to the following criteria:

  • Core set (3-star rating): OM that demonstrated strong evidence for validity, reliability, responsiveness and clinical utility AND were recommended by at least two sources.

  • Extended set (2-star rating): OM that demonstrated strong evidence for validity, reliability, responsiveness and clinical utility OR were recommended by at least two sources.

  • Supplementary set (1-star rating): OM that showed some evidence for validity, reliability, responsiveness and clinical utility OR were recommended by at least one of the sources.

The core (3-star) and extended (2-star) sets of CAULIN recommended OM represent OM that are psychometrically sound, have suitable clinical utility and have a solid support base in the clinical and research community. The core 3-star OM should, however, always be considered as a first choice for all clinical trials and implementation protocols in clinical settings. The 1-star rated OM represent those with good potential, but where the psychometric properties, clinical utility or expert consensus is not fully established. These measures could be used where appropriate or for research purposes. For example, additional specific OM might be needed when investigating specific treatments, such as robot-assisted therapy or home-based therapy, or when patients present with specific problems or treatment goals.

Assessment procedures

Two of the three sources, i.e., clinical practice guidelines and expert consensus, generated data on recommended procedures for assessment of upper limb functioning. Based on available information, data was extracted and categorized according to three characteristics: time spent in assessment; frequency and timing of assessments; person who should conduct the assessments. Due to limited data available, rating of recommendations as done with OM selection couldn’t be applied to assessment procedures, instead data synthesis consisted of summarizing and categorizing the evidence.

Results

Recommended OM

The synthesized results for the CAULIN recommendations on specific OM are shown in Table 1. A general recommendation concerning the scope of upper limb assessment has been highlighted across the three data sources: OM must be valid, reliable, responsive, clinically available and useful, preferably a consolidated set. In total, 12 specific OM were included, covering body function and activity level of the ICF (Fig. 2).

Table 1 Overview of synthesized data from systematic review of OM, review of clinical practice guidelines and expert consensus
Fig. 2
figure 2

CAULIN recommendations for selected specific upper limb outcome measures in neurorehabilitation

The recommended core set (3-star rating) of OM for clinical practice consists of Fugl-Meyer Assessment of Upper Extremity (FMA-UE) and Action Research Arm Test (ARAT). These were the only two measures presenting good psychometric properties while being recommended in at least two of the three data sources (systematic reviews of OM and clinical practice guidelines).

The extended set (2-star rating) adds six more OM recommended for clinical practice and/or clinical research. Kinematic measures assessing movement quality and execution are recommended at body function level, although there isn’t sufficient information available in the examined sources to specify which kinematic variable(s) should be used (i.e., range of motion, smoothness, etc.). Recommended OM to assess at activity level add four capacity measures with each a slightly different focus: Box and Block Test (BBT; timed unilateral gross motor dexterity), Chedoke Arm Hand Activity Inventory (CAHAI; focusing on bilateral task execution), Wolf Motor Function Test (WMFT; uni- and bilateral timed performance and ability scoring), Nine Hole Peg Test (NHPT, timed unilateral fine motor dexterity); and the ABILHAND (patient-reported manual ability measure).

The supplementary set (1-star rating) includes additional OM that can be used for specific research purposes. On body function level, the Motricity Index (MI), Chedoke-McMaster Stroke Assessment (CMSA) and Stroke Rehabilitation Assessment Movement (STREAM) are added. On activity level, the Frenchay Arm Test (FAT) and Motor Assessment Scale (MAS) are additional recommended OM to measure functional ability (activity capacity), as well as monitoring the amount of actual arm use in routine daily life (activity performance) through the use of body-worn movement sensors (e.g., accelerometers, inertial measurement units—IMU).

Recommended assessment procedures

Although the extent of information available is limited on when and by whom assessments should be conducted, we have summarized the available evidence on assessment procedures from the three published data sources (Table 2), as follows:

  1. 1.

    Assessments should be conducted at regular intervals during rehabilitation at a minimum of four time points (early, 3-, 6- and 12-months after onset).

  2. 2.

    Global measures should be applied within 24 h of hospital admission and upper limb specific measures within 1 week.

  3. 3.

    During a rehabilitation program, assessment should be made at baseline (beginning of the program), interim (during the program), final (end of the program), and follow-up (a set period of time after completion of the program).

  4. 4.

    Patients should always be assessed prior to discharge or transfer in order to support appropriate follow-up.

  5. 5.

    OM should be administered separately from treatment, last no longer than three hours and be conducted by healthcare professionals who are trained to use them.

Table 2 Recommendations for assessment procedures

Discussion

By combining existing evidence on OM from literature reviews, a systematic overview of national clinical practice guidelines across Europe and beyond, and expert consensus on a pan-European level, we compiled uniform and agreed evidence-based recommendations for Clinical Assessment of Upper Limb In Neurorehabilitation (CAULIN). As such, CAULIN provides evidence-based recommendations for upper limb assessment of patients with neurological conditions, primarily stroke, before, during and after therapy (either conventional or technology-assisted therapy), to be used primarily in clinical applications, but also in clinical research. Furthermore, CAULIN defines the recommended time frame of applying structured assessment at four specific instances (early, 3, 6 and 12 months after admission). The CAULIN recommendations defined OM at three levels: core set (including 2 OM), extended set (adding 6 OM), and supplementary set (extending by 6 OM).

The core set recommends FMA-UE and ARAT to be included as the core (3-star) assessments of upper limb function and activity capacity in clinical practice. This is in agreement with the consensus-based recommendations of the Stroke Recovery and Rehabilitation Roundtable (SRRR) [18] and the results of a recent consensus-based Delphi study [19]. The current outcome strengthens the recommendation of the use of FMA-UE and ARAT in routine clinical practice by collating evidence, not only from consensus-based methods, but also from systematic reviews on existing literature and clinical practice guidelines. The global coverage of SRRR consensus further supports the pan-European CAULIN core set recommendations for assessing upper limb function and capacity. Even though FMA-UE and ARAT assess upper limb functioning at different levels of the ICF framework and measure different constructs, strong correlations exist between both OM [20, 21]. It is recommended to apply both FMA-UE and ARAT whenever possible to cover both aspects of functioning. A choice for one over the other can however be based on the patient-specific treatment goals if needed (e.g., if administration time is limited).

The extended (2-star) set includes a mix of performance-based and patient-reported OM (PROM), addressing both capacity and perceived performance of the arm in daily life. These assessments can be used as complementary assessments, depending on patient-specific treatment goals or needs in clinical practice, or on specific research objectives in clinical research. For example, while the BBT and NHPT are easy to implement into clinical practice (i.e., they are short and quick to administer), they will provide summary information on task outcome. On the other hand, some of the other recommended OM are more comprehensive and will take more time and training, while adding valuable information on task execution and strategies used by the patient. The CAULIN recommendations, however, emphasize that the core OM (FMA-UE and ARAT) should be prioritized over the extended and supplementary OM sets.

In addition, the CAULIN extended (2-star) set recommends kinematic measures for assessment of movement quality on body function level. This extends the information gained through clinical assessments about task execution with more detailed information about its underlying aspects, for example movement smoothness [22]. This recommendation is primarily applicable for evaluation of specific, well-established tasks (e.g. reaching or pointing) implemented in clinical practice or clinical research. The use of kinematic measures has been encouraged to allow distinction between behavioural motor recovery and compensation [23, 24]. Furthermore, kinematic measures enable detection of more subtle and fine-grained changes and are thought to provide valuable information for individual treatment planning and evaluation [25]. Similar to CAULIN recommendations, the 1st SRRR initiative could not recommend specific kinematic measures for clinical research [23]. A more recent 2nd SRRR initiative, however, did specify a set of consensus-based kinematic measures for clinical research trials [6]. These guidelines propose kinematic data to be collected during two standardized movement tasks: a reaching task in the horizontal plane and a functional 3D reach-to-grasp task, such as drinking from a glass [6].

The use of PROM is recommended in each of the three CAULIN sources for perceived activity performance, with the ABILHAND as the only specific tool demonstrating sufficiently strong psychometric properties and clinical utility. In line with the overall aim of rehabilitation, perceived performance measures add valuable and necessary information about a person’s experienced limitations of upper limb use in daily life [26]. In the present synthesis, PROM were mentioned in all sources to deserve attention during UL assessment, but specific PROM’s besides ABILHAND couldn’t be extracted. Other OM exist that might be suitable (more detailed information is in the publications of the three data sources), but more effort to establish specific PROM guidelines is needed.

The evidence-base for assessments included in the supplementary (1-star) set is smaller compared to recommended 3- and 2-star OM. The additional OM in the supplementary set will primarily be applicable for clinical research or in specific contexts of clinical practice, depending on research questions or patient-specific treatment goals, as each of these assessments have their particular focus and advantages. One of the OM included in the supplementary set is sensor-based assessment of actual arm use in daily life. This adds the perspective of actual performance in ecologically valid real-life settings to that of capacity measures, assessing the maximum score in a controlled setting, which are known to be incongruent [27]. Although a standardized way to implement sensor-based assessment of actual arm use as an activity performance measure couldn’t be established in the current work, studies have indicated that assessing the actual use of the affected arm in daily life with respect to the unaffected arm (using activity counts) provides insight in non-use of the affected arm and relates more to real-world arm use than functional outcome measures [28, 29]. Nevertheless, establishing the optimal way for application and analysis requires further research.

The use of goal attainment OM were mentioned in all three CAULIN sources, although no specific OM could be identified. Remarkably, a Cochrane review reported that only 3 out of 39 studies, investigating the effect of goal-setting on psychosocial outcomes during rehabilitation of people with acquired disability, used a goal attainment evaluation [30]. Goal Attainment Scaling was the only OM used in those studies. A clinical guideline on integrating goal setting into rehabilitation to inform individual treatment planning listed nine useful goal attainment OM, but also wasn’t able to suggest a specific goal attainment OM [31]. Nevertheless, the current findings underline that goal attainment OM should be considered in clinical practice and further research is needed to define suitable goal attainment OM.

In terms of assessment procedures, the current synthesis derived the following recommendation: administration of upper limb specific OM should be done by trained healthcare professionals within 1 week of admission to rehabilitation and repeated prior to discharge or transfer, with specific time points during rehabilitation (upon start, during, end of programme, with a follow-up assessment). Despite the recognized importance of structured administration procedures, more specific recommendations couldn’t be derived from the current synthesis. When considering only consensus-based evidence, specific advice on time points for clinical assessment has recently been proposed, with maximal 7 assessments across 12 months: within 3 days (OM at body functions level only), at day 7, at weeks 2, 4, 12, at 6 months, followed by every 6th month [19]. These proposed timepoints are generally in alignment with the procedures recommended in CAULIN. Beyond this, more explicit recommendations on administration procedures beyond timing of assessment are desired for better comparability of outcomes.

Considerations and limitations

The current work has identified uniform and agreed OM for clinical assessment of upper limb with pan-European coverage, integrating evidence on psychometric properties with clinical practice guidelines and with evidence-based consensus among clinicians, researchers and engineers, considering also clinical utility in aspects such as language availability, affordability and practical applicability. Despite these strengths, several limitations and considerations should be noted.

Kinematic measures and sensor-based actual arm use are included in the current recommendations to quantify movement quality and arm/hand use on body function and activity level, even though clinical applicability isn’t well-established yet. Such technology-supported assessments are increasingly used in research [32, 33], but they haven’t found their way to large scale application in clinical practice. Current limitations are a lack of a standardized way to apply and analyse the data and missing information regarding its psychometric properties for the various scenarios [15, 34]. In case of kinematic assessment an additional, contemporary, limitation is the need for high-resolution, three-dimensional optoelectronic systems [6], limiting application to specialized clinical centres that have access to such advanced systems and expertise required for the corresponding analysis. Apparently, the expected added value of objective measurement of upper limb function or actual use is compelling enough to have caught the attention of both researchers and healthcare professionals [17]. This is based on the rapid ongoing technological developments of equipment suitable for use outside of expert labs, such as accelerometers, inertial measurement units (IMU’s) or markerless video-based systems. Although currently regarded as not mature or user-friendly enough for routine use in clinical practice [6], it is expected that this will become possible in the coming years. This will then enable measurement of kinematic data and/or actual arm use in clinical settings during therapy, on the ward and even at home, without the need for advanced optoelectronic systems. Based on the current synthesis, it is clear that this topic warrants further research.

Potential cultural differences that can influence the validity of task-based assessments (e.g., using cutlery) haven’t been directly addressed, even though language availability of OM has been considered. For example, for the FMA-UE official transcultural adaptations and validations are available [35,36,37,38]. Also, some of the clinical assessments that are part of the CAULIN recommendations are available in revised or shortened forms, optimising administration time or psychometric properties [39,40,41], but this hasn’t been taken into consideration in this work.

Furthermore, the current synthesis shows that the majority of information about upper limb assessment deals with stroke. Nevertheless, wherever available, the CAULIN recommendations have used information on upper limb assessment from other populations. Based on available clinical practice guidelines, most information besides stroke was available from TBI, followed by SCI and MS [16]. For MS, the OM in CAULIN recommendations are in alignment with a previous review recommending amongst others NHPT, BBT, ARAT and WMFT as appropriate OM for MS [42]. Likewise, in SCI the ARAT has been used and recommended as primary upper limb functional outcome measure in clinical trials [43, 44]. Therefore, although being represented to a smaller extent than the stroke population, available evidence endorses the applicability of OM in the CAULIN recommendations for other neurological populations (TBI, SCI, MS), while considering the suitability of specific OM for the target population (e.g., FMA-UE would be applicable to TBI but not to SCI, ARAT is developed for stroke but is also used in SCI and MS).

The current work showed that PROM, goal attainment OM and sensor-based assessment of actual arm use in daily life are important concepts to include in upper limb assessment, although concrete recommendations based on consensus, clinical utility and psychometric properties, can’t be provided at this point. More research is needed to establish specific measures and/or methods. In addition, technological development is required to mature measurement systems and methods for use in clinical practice or research. This is also valid for kinematic measures of movement quality, even though a basic application could be specified in the extended set of CAULIN recommendations. Increased availability of assessment of movement and task performance on ratio-level, considering such developments in the (near) future, enables better detection of underlying, detailed changes. This will add valuable information for prognosis of recovery and corresponding treatment planning on individual level, which can benefit the rehabilitation process [45].

It is, however, conceivable that any new or additional OM will meet the selection criteria as defined for the CAULIN recommendations at some point. Moreover, some of those new or additional measures could potentially outperform some of the OM in the current selection, especially those with subjective (by the tester) and ordinal-level scoring involved. This entails that the recommendations should be updated in the future on a regular basis, to incorporate additional measures and revisit the selection of recommended OM, when these become available. Nevertheless, this means that the current CAULIN recommendations are limited to OM currently available in clinical practice.

Conclusions

The CAULIN recommendations for OM and assessment procedures provide a clear, simple, evidence-based three-level structure for upper limb assessment in neurological rehabilitation. OM in all three levels have proven psychometric properties as well as evidence derived from systematic reviews and expert consensus. The three levels are: (1) Core set: OM that should be applied routinely in clinical practice with neurological patients undergoing conventional or technology-enhanced upper limb rehabilitation; (2) Extended set: OM that may be useful in clinical practice but are recommended as standard for research, and (3) Supplementary set: OM for specific research purposes. The CAULIN recommendations provide a comprehensive framework, in the context of currently available OM, within which to investigate the effectiveness of (technology-supported) interventions and better understand which patients benefit from which training approach. This will facilitate treatment planning in clinical practice on patient-specific basis. Widespread adoption and sustained use of the recommendations will increase opportunities for data pooling and meta-analysis, critical for the advancement of neurological rehabilitation.

Availability of data and materials

Data sharing is not applicable to this article as no datasets were generated or analysed during the current study. Data that was used as input for the current synthesis have been published earlier [15,16,17].

Abbreviations

CAULIN:

Clinical Assessment of Upper Limb In Neurorehabilitation

WHO:

World Health Organisation

OM:

Outcome Measures

COST:

European Co-operation in Science and Technology

AGREE:

Appraisal of Guidelines for Research and Evaluation

ICF:

International Classification of Functioning, Disability and Health

SCI:

Spinal cord injury

MS:

Multiple sclerosis

TBI:

Traumatic brain injury

CP:

Cerebral palsy

PD:

Parkinson’s disease

EU:

European Union

FMA-UE:

Fugl-Meyer Assessment of Upper Extremity

ARAT:

Action Research Arm Test

BBT:

Box and Block Test

CAHAI:

Chedoke Arm Hand Activity Inventory

WMFT:

Wolf Motor Function Test

NHPT:

Nine Hole Peg Test

ABILHAND:

Patient-reported manual ability measure

MI:

Motricity Index

CMSA:

Chedoke-McMaster Stroke Assessment

STREAM:

Stroke Rehabilitation Assessment Movement

FAT:

Frenchay Arm Test

MAS:

Motor Assessment Scale

IMU:

Inertial Measurement Units

EMG:

Electromyography

TMS:

Trans-cranial Magnetic Stimulation

FIM:

Functional Independence Measure

BI:

Barthel Index

SRRR:

Stroke Recovery and Rehabilitation Roundtable

PROM:

Patient-Reported Outcome Measures

References

  1. Feigin VL, Abajobir AA, Abate KH, Abd-Allah F, Abdulle AM, Abera SF, et al. Global, regional, and national burden of neurological disorders during 1990–2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet Neurol. 2017;16:877–97.

    Article  Google Scholar 

  2. Gimigliano F, Negrini S. The World Health Organization “Rehabilitation 2030: a call for action.” Eur J Phys Rehabil Med. 2017;53:155–68.

    Article  Google Scholar 

  3. Rudd AG, Bowen A, Young G, James MA. National clinical guideline for stroke, 5th edn 2016. Clin Med (Northfield Il). Royal College of Physicians; 2017.

  4. Stroke Foundation. Clinical guidelines for stroke management. Melbourne, Australia; 2021 (cited 2021 Mar 30). https://informme.org.au/en/Guidelines/Clinical-Guidelines-for-Stroke-Management.

  5. Winstein CJ, Stein J, Arena R, Bates B, Cherney LR, Cramer SC, et al. Guidelines for adult stroke rehabilitation and recovery. Stroke. 2016;47:e98-169.

    Article  Google Scholar 

  6. Kwakkel G, van Wegen EEH, Burridge JH, Winstein CJ, van Dokkum LEH, Alt Murphy M, et al. Standardized measurement of quality of upper limb movement after stroke: consensus-based core recommendations from the second stroke recovery and rehabilitation roundtable. Neurorehabil Neural Repair. 2019;33:951–8.

    Article  CAS  Google Scholar 

  7. Timmermans AAA, Seelen HAM, Geers RPJ, Saini PK, Winter S, te Vrugt J, et al. Sensor-based arm skill training in chronic stroke patients: results on treatment outcome, patient motivation, and system usability. IEEE Trans Neural Syst Rehabil Eng. 2010;18:284–92.

    Article  Google Scholar 

  8. Timmermans AAA, Lemmens RJM, Monfrance M, Geers RPJ, Bakx W, Smeets RJEM, et al. Effects of task-oriented robot training on arm function, activity, and quality of life in chronic stroke patients: a randomized controlled trial. J Neuroeng Rehabil. 2014;11:45.

    Article  Google Scholar 

  9. Timmermans AAA, Lemmens RJM, Geers RPJ, Smeets RJEM, Seelen HAM. A comparison of treatment effects after sensor- and robot-based task-oriented arm training in highly functional stroke patients. Conf IEEE Eng Med Biol Soc United States; 2011; pp. 3507–10.

  10. Meyer MJ, Pereira S, Mcclure A, Teasell R, Thind A, Koval J, et al. A systematic review of studies reporting multivariable models to predict functional outcomes after post-stroke inpatient rehabilitation. Disabil Rehabil. 2015;37:1316–23.

    Article  Google Scholar 

  11. Nijland RHM, van Wegen EEH, Van Der Wel HBC, Kwakkel G. Presence of finger extension and shoulder abduction within 72 hours after stroke predicts functional recovery: early prediction of functional outcome after stroke: the EPOS cohort study. Stroke. 2010;41:745–50.

    Article  Google Scholar 

  12. Stinear CM, Byblow WD, Ackerley SJ, Smith MC, Borges VM, Barber PA. PREP2: a biomarker-based algorithm for predicting upper limb function after stroke. Ann Clin Transl Neurol. 2017;4:811–20.

    Article  Google Scholar 

  13. Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. Can Med Assoc J. 2010;182:E839–42.

    Article  Google Scholar 

  14. Cattaneo D, Lamers I, Bertoni R, Feys P, Jonsdottir J. Participation restriction in people with multiple sclerosis: prevalence and correlations with cognitive, walking, balance, and upper limb impairments. Arch Phys Med Rehabil. 2017;98:1308–15.

    Article  Google Scholar 

  15. Alt Murphy M, Resteghini C, Feys P, Lamers I. An overview of systematic reviews on upper extremity outcome measures after stroke. BMC Neurol. 2015;15:29.

    Article  Google Scholar 

  16. Burridge J, Alt Murphy M, Buurke J, Feys P, Keller T, Klamroth-Marganska V, et al. A systematic review of international clinical guidelines for rehabilitation of people with neurological conditions: what recommendations are made for upper limb assessment? Front Neurol. 2019;10:567.

    Article  Google Scholar 

  17. Hughes A-M, Bouças SB, Burridge JH, Alt Murphy M, Buurke J, Feys P, et al. Evaluation of upper extremity neurorehabilitation using technology: a European Delphi consensus study within the EU COST Action Network on Robotics for Neurorehabilitation. J Neuroeng Rehabil. 2016;13:86.

    Article  Google Scholar 

  18. Bernhardt J, Borschmann KN, Kwakkel G, Burridge JH, Eng JJ, Walker MF, et al. Setting the scene for the second stroke recovery and rehabilitation roundtable. Int J Stroke. 2019;14:450–6.

    Article  Google Scholar 

  19. Pohl J, Held JPO, Verheyden G, Alt Murphy M, Engelter S, Floel A, et al. Consensus-based core set of outcome measures for clinical motor rehabilitation after stroke-a Delphi study. Front Neurol. 2020;11:875.

    Article  Google Scholar 

  20. Wei XJ, Tong KY, Hu XL. The responsiveness and correlation between Fugl-Meyer Assessment, Motor Status Scale, and the Action Research Arm Test in chronic stroke with upper-extremity rehabilitation robotic training. Int J Rehabil Res. 2011;34:349–56.

    Article  Google Scholar 

  21. Rabadi MH, Rabadi FM. Comparison of the action research arm test and the Fugl-meyer assessment as measures of upper-extremity motor weakness after stroke. Arch Phys Med Rehabil. 2006;87:962–6.

    Article  Google Scholar 

  22. Alt Murphy M, Willén C, Sunnerhagen KS. Movement kinematics during a drinking task are associated with the activity capacity level after stroke. Neurorehabil Neural Repair. 2012;26:1106–15.

    Article  Google Scholar 

  23. Kwakkel G, Lannin NA, Borschmann K, English C, Ali M, Churilov L, et al. Standardized measurement of sensorimotor recovery in stroke trials: consensus-based core recommendations from the stroke recovery and rehabilitation roundtable. Neurorehabil Neural Repair. 2017;31:784–92.

    Article  Google Scholar 

  24. Demers M, Levin MF. Do activity level outcome measures commonly used in neurological practice assess upper-limb movement quality? Neurorehabil Neural Repair. 2017;31:623–37.

    Article  Google Scholar 

  25. Thrane G, Sunnerhagen KS, Persson HC, Opheim A, Alt MM. Kinematic upper extremity performance in people with near or fully recovered sensorimotor function after stroke. Physiother Theory Pract. 2019;35:822–32.

    Article  Google Scholar 

  26. Lamers I, Feys P. Assessing upper limb function in multiple sclerosis. Mult Scler. 2014;20:775–84.

    Article  Google Scholar 

  27. Michielsen ME, de Niet M, Ribbers GM, Stam HJ, Bussmann JB. Evidence of a logarithmic relationship between motor capacity and actual performance in daily life of the paretic arm following stroke. J Rehabil Med. 2009;41:327–31.

    Article  Google Scholar 

  28. Thrane G, Emaus N, Askim T, Anke A. Arm use in patients with subacute stroke monitored by accelerometry: association with motor impairment and influence on self-dependence. J Rehabil Med. 2011;43:299–304.

    Article  Google Scholar 

  29. Lang CE, Bland MD, Bailey RR, Schaefer SY, Birkenmeier RL. Assessment of upper extremity impairment, function, and activity after stroke: foundations for clinical decision making. J Hand Ther. 2013;26:104–15.

    Article  Google Scholar 

  30. Levack WM, Weatherall M, Hay-Smith EJ, Dean SG, McPherson K, Siegert RJ. Goal setting and strategies to enhance goal pursuit for adults with acquired disability participating in rehabilitation. Cochrane Database Syst Rev. 2015. https://doi.org/10.1002/14651858.CD009727.pub2.

    Article  PubMed  Google Scholar 

  31. New A, Horton A. Rehabilitation goal-setting guideline and implementation toolkit. Statewide Rehabilitation Clinical Network Clinical Excellence Queensland 2|Rehabilitation goal-setting guideline and implementation toolkit. 2019 (cited 2020 Dec 21). p. 1–19. https://clinicalexcellence.qld.gov.au/resources/goal-setting-rehabilitation/guidelines-and-resources.

  32. Wang Q, Markopoulos P, Yu B, Chen W, Timmermans A. Interactive wearable systems for upper body rehabilitation: a systematic review. J Neuroeng Rehabil. 2017;14:20.

    Article  Google Scholar 

  33. Alt Murphy M, Häger CK. Kinematic analysis of the upper extremity after stroke–how far have we reached and what have we grasped? Phys Ther Rev. 2015;20:137–55.

    Article  Google Scholar 

  34. Schwarz A, Kanzler CM, Lambercy O, Luft AR, Veerbeek JM. Systematic review on kinematic assessments of upper limb movements after stroke. Stroke. 2019;50:718–27.

    Article  Google Scholar 

  35. Cecchi F, Carrabba C, Bertolucci F, Castagnoli C, Falsini C, Gnetti B, et al. Transcultural translation and validation of Fugl–Meyer assessment to Italian. Disabil Rehabil. 2020; pp. 1–6.

  36. Barbosa NE, Forero SM, Galeano CP, Hernández ED, Landinez NS, Sunnerhagen KS, et al. Translation and cultural validation of clinical observational scales—the fugl-meyer assessment for post stroke sensorimotor function in colombian spanish. Disabil Rehabil. 2019;41:2317–23.

    Article  Google Scholar 

  37. Busk H, Alt Murphy M, Korsman R, Skou ST, Wienecke T. Cross-cultural translation and adaptation of the Danish version of the Fugl-Meyer assessment for post stroke sensorimotor function. Disabil Rehabil. 2021. https://doi.org/10.1080/09638288.2021.1919215.

    Article  PubMed  Google Scholar 

  38. Kim T, Hwang SH, Lee WJ, Hwang JW, Cho I, Kim E-H, et al. The Korean version of the Fugl-Meyer assessment: reliability and validity evaluation. Ann Rehabil Med. 2021;45:83–98.

    Article  Google Scholar 

  39. Woodbury ML, Velozo CA, Richards LG, Duncan PW. Rasch analysis staging methodology to classify upper extremity movement impairment after stroke. Arch Phys Med Rehabil. 2013;94:1527–33.

    Article  Google Scholar 

  40. Bogard K, Wolf S, Zhang Q, Thompson P, Morris D, Nichols-Larsen D. Can the Wolf Motor Function Test be streamlined? Neurorehabil Neural Repair. 2009;23:422–8.

    Article  Google Scholar 

  41. Whitall J, Savin DN, Harris-Love M, Waller SMC. Psychometric properties of a modified wolf motor function test for people with mild and moderate upper-extremity hemiparesis. Arch Phys Med Rehabil. 2006;87:656–60.

    Article  Google Scholar 

  42. Lamers I, Kelchtermans S, Baert I, Feys P. Upper limb assessment in multiple sclerosis: a systematic review of outcome measures and their psychometric properties. Arch Phys Med Rehabil. 2014;95:1184–200.

    Article  Google Scholar 

  43. Kowalczewski J, Chong SL, Galea M, Prochazka A. In-home tele-rehabilitation improves tetraplegic hand function. Neurorehabil Neural Repair. 2011;25:412–22.

    Article  Google Scholar 

  44. Harvey LA, Dunlop SA, Churilov L, Galea MP, Spinal Cord Injury Physical Activity Hands On Trial C. Early intensive hand rehabilitation is not more effective than usual care plus one-to-one hand therapy in people with sub-acute spinal cord injury ('Hands On’): a randomised trial. J Physiother. 2017;63:197–204.

    Article  Google Scholar 

  45. Stinear CM, Byblow WD, Ackerley SJ, Barber PA, Smith M-C. Predicting recovery potential for individual stroke patients increases rehabilitation efficiency. Stroke. 2017;48:1011–9.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank all participants to the Robotics for NeuroRehabilitation COST Action for their valuable input into the expert consensus meetings and the discussions during plenary COST meetings that emphasized the need and shaped the approach resulting in these recommendations.

Funding

The European Network on Robotics for NeuroRehabilitation (Working Group 1) developed these recommendations. Their work was funded by the European Co-Operation in Science and Technology (COST Action TD1006) programme. The funding body had no role in or influence on the selected approach and synthesis, analysis, and interpretation of data and in writing the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

TK, JHB, AH made substantial contributions to the conception and GPL, MAM, IL made substantial contributions to the design of the work; AH, MAM, IL, JHB, GPL contributed substantially to the synthesis and analysis of the data, AT, VKM, JB, PF, IT, TK contributed substantially to interpretation of the outcomes; GPL, MAM, AH, IL, JHB have drafted the work or substantively revised it. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Gerdienke B. Prange-Lasonder.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Prange-Lasonder, G.B., Alt Murphy, M., Lamers, I. et al. European evidence-based recommendations for clinical assessment of upper limb in neurorehabilitation (CAULIN): data synthesis from systematic reviews, clinical practice guidelines and expert consensus. J NeuroEngineering Rehabil 18, 162 (2021). https://doi.org/10.1186/s12984-021-00951-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12984-021-00951-y

Keywords