Skip to main content

The Berlin Bimanual Test for Tetraplegia (BeBiTT): development, psychometric properties, and sensitivity to change in assistive hand exoskeleton application

Abstract

Background

Assistive hand exoskeletons are promising tools to restore hand function after cervical spinal cord injury (SCI) but assessing their specific impact on bimanual hand and arm function is limited due to lack of reliable and valid clinical tests. Here, we introduce the Berlin Bimanual Test for Tetraplegia (BeBiTT) and demonstrate its psychometric properties and sensitivity to assistive hand exoskeleton-related improvements in bimanual task performance.

Methods

Fourteen study participants with subacute cervical SCI performed the BeBiTT unassisted (baseline). Thereafter, participants repeated the BeBiTT while wearing a brain/neural hand exoskeleton (B/NHE) (intervention). Online control of the B/NHE was established via a hybrid sensorimotor rhythm-based brain-computer interface (BCI) translating electroencephalographic (EEG) and electrooculographic (EOG) signals into open/close commands. For reliability assessment, BeBiTT scores were obtained by four independent observers. Besides internal consistency analysis, construct validity was assessed by correlating baseline BeBiTT scores with the Spinal Cord Independence Measure III (SCIM III) and Quadriplegia Index of Function (QIF). Sensitivity to differences in bimanual task performance was assessed with a bootstrapped paired t-test.

Results

The BeBiTT showed excellent interrater reliability (intraclass correlation coefficients > 0.9) and internal consistency (α = 0.91). Validity of the BeBiTT was evidenced by strong correlations between BeBiTT scores and SCIM III as well as QIF. Wearing a B/NHE (intervention) improved the BeBiTT score significantly (p < 0.05) with high effect size (d = 1.063), documenting high sensitivity to intervention-related differences in bimanual task performance.

Conclusion

The BeBiTT is a reliable and valid test for evaluating bimanual task performance in persons with tetraplegia, suitable to assess the impact of assistive hand exoskeletons on bimanual function.

Introduction

Due to impaired hand function, individuals with tetraplegia often depend on assistance to perform activities of daily living (ADLs). Patients reported that regaining arm and hand function was their most important goal after cervical spinal cord injury (cSCI) [1, 2]. A common approach to restore hand function in cSCI uses tendon transfer, but this is associated with surgical risks such as infection, tissue damage and anesthetic complications. Moreover, success of tendon transfer highly depends on the quality of muscles and tendons used for such transfer [3, 4]. Another promising approach to restore motor function after cSCI utilizes exoskeletons, i.e., mechanical structures that mobilize the paralyzed limb. In this context, brain–computer interfaces (BCIs) that bypass the lesioned cortico-spinal tract by translating brain activity into control commands have proven particularly promising for intuitive and versatile control of such assistive devices. By using an implantable BCI, severely paralyzed SCI survivors were enabled, e.g., to grasp objects of daily living with a prosthetic arm or exoskeleton [5,6,7]. Besides implantable approaches that entail the risk of surgical complications, also non-invasive brain-controlled exoskeletons were established, allowing SCI survivors with tetraplegia to independently perform ADLs outside the laboratory (e.g., eating and drinking in a restaurant) [8]. Here, desynchronization of sensorimotor rhythms (SMR) associated with the intention to grasp results in exoskeleton-driven closing motions of the paralyzed hand, while horizonal oculoversions (HOV) opens the hand or stops an unintended closing motion [9]. Since it was shown that repeated use of BCI-driven robotic devices can facilitate motor recovery [10,11,12,13], such hybrid brain/neural hand exoskeletons (B/NHE) might play an increasing role for restoration of hand function.

Up to now, the impact of assistive hand exoskeletons on motor function in tetraplegia has only been assessed for unilateral use [8, 14,15,16]. Many relevant ADLs, however, require the coordinated interplay of both hands, known as bimanual function [17]. Given the importance of bimanual tasks in daily life, it would be important to reliably assess the impact of assistive hand exoskeletons on such bimanual ADLs in tetraplegia. However, there is currently no reliable and valid clinical test available for such purpose. Commonly applied hand function tests, such as the Grasp and Release Test, Capabilities of Upper Extremity Test and Toronto Rehabilitation Institute Hand Function Test (TRI-HFT) do not take bimanual function into account [18,19,20]. Apart from that, established ADL tests (e.g., the Spinal Cord Independence Measure) are not suitable to assess the impact of assistive exoskeletons since their scoring system solely focuses on level of independence, which, by nature, is biased when applying any assistive device [21].

To overcome this lack of a suitable clinical test, we introduce the Berlin Bimanual Test for Tetraplegia (BeBiTT)—a performance-based test to assess bimanual hand function in tetraplegia that is compatible with the use of assistive exoskeletons. Here, we elucidate the rationale, the design and application of the BeBiTT, and provide evidence for its internal consistency, interrater-reliability, and construct validity across fourteen tetraplegic individuals. To demonstrate the BeBiTT´s sensitivity to assess assistive hand exoskeleton-related improvements in bimanual task performance, the test was applied across ten cSCI survivors who performed the test without (baseline) and with B/NHE assistance (intervention).

Methods

Development of the Berlin Bimanual Test for Tetraplegia (BeBiTT)

The BeBiTT is a clinical test designed to assess bimanual task performance in individuals with tetraplegia. It builds on a comprehensive theoretical framework (Fig. 1) and includes conceptual aspects of the Chedoke Arm & Hand Activity Inventory, a well-known test for bimanual performance in the stroke population [22]. The selected test items were selected to cover all grasp patterns relevant in everyday life (tripod pinch, tip pinch, lateral pinch, power grip, spherical grip, and extension grip) and address multiple ADL categories such as eating and drinking, dressing, and personal hygiene. In this way, the participant’s level of functioning can be assessed that reflects the International Classification of Functioning, Disability and Health (ICF) criteria, i.e., body function, activity, and participation. Further, the test items ought to include various types of bimanual actions according to the taxonomy of Kantak et al. [23]. According to the taxonomy, bimanual actions can be divided into symmetric movements involving the use of homologous muscles, and asymmetric movements in which non-homologous muscles are engaged. Further, bimanual actions can be differentiated according to whether each arm/hand intends to achieve an independent goal or whether both hands work together to accomplish a task (common goal tasks). In the latter case, the movements can be executed sequentially (referred to as parallel) or require a cooperative spatio-temporal interaction. While originally designed for stroke populations, we considered Kantak’s taxonomy in the BeBiTT to include a broad range of bimanual actions with varying requirements for coordination.

Fig. 1
figure 1

Theoretical framework of the BeBiTT

To find potential test items, a list of 32 bimanual tasks that are impaired in individuals with tetraplegia were generated based on open interviews with affected persons as well as physio- and occupational therapists (both having at least 10 years of working experience with SCI patients). All items were then grouped according to their ADL category (Table 1). With the predefined theoretical framework as a guideline, the most suitable items were selected. Since the BeBiTT was designed to assess the impact of neuroprosthetics and brain-controlled assistive hand exoskeletons, items that involve direct contact to private parts, e.g., in the context of toileting or self-catheterization, was not included. As object manipulation is a core element of bimanual function, items were discarded that did not contain a significant manipulation component such as wheelchair use or transferring and lifting objects only. Moreover, items that appeared too broad to be transferred into practical test tasks like driving a car or playing games were not considered. For practicality in clinical environments, the number of items was kept to a minimum. As a result, 9 items have been chosen for the final version of the BeBiTT, all representing relevant bimanual tasks of daily living that are impaired in individuals with tetraplegia (Table 2). The material needed for the BeBiTT is usually available in clinics and research laboratories and, if not, can be purchased at low cost anywhere in the world (Table 2). Due to its short and easy administration, the BeBiTT normally takes no longer than 20 min to complete. To reliably assess the BeBiTT score, raters are provided with a systematic scoring system (Additional file 1). The scoring system is designed to evaluate the main components of bimanual function in daily activities, i.e., grasping, manipulating, and lifting. For grasping, the scoring system pays special attention whether an active or passive grip is used to accomplish the task. Passive grip refers to the concept of grasping objects with the help of passive tension in the fingers, e.g., by extending the wrist in the so-called tenodesis grasp. While a passive grip is often not very dexterous and powerful, exerting active finger strength contributes to good control and ability to manipulate an object. Accordingly, 2 points are assigned in case an active/firm grip is performed and 1 point is assigned if a passive/loose grip is performed (evaluated for each hand). Moreover, the scoring systems accounts for the level of difficulty the participant experiences during bimanual manipulation and considers the use of compensatory mechanisms. Compensatory mechanisms refer to the use of body parts or functions that are usually not involved in a particular action to compensate for impaired function (e.g., using both hands for a one-handed activity or pinching objects between legs for manipulation). No difficulty in manipulating results in 4 points, slight difficulty in 3 points, great difficulty in 2 points, and 1 point is assigned when solely compensatory strategies are used. Lifting is a good way to evaluate bilateral arm and shoulder function and 2 points are assigned if the bimanual manipulation is performed in a lifted position. Altogether, a maximum of 10 points can be achieved per task (4 for grasping, 4 for manipulating and 2 for lifting). In case a task does not involve any meaningful lifting component, 4 points are assigned for grasping and 6 points for manipulating (Additional file 1). With 9 test items, this results in a score ranging from 0 to 90 points, with 0 points indicating no bimanual function and 90 points indicating unimpaired bimanual function in tetraplegia.

Table 1 List of generated items grouped in ADL categories
Table 2 Berlin bimanual test for tetraplegia

Participants

14 individuals with tetraplegia were recruited (13 male, mean age 48.6 ± 18.5 years) with complete (n = 6; ASIA grade A) and incomplete (n = 8; ASIA grades B–C) cSCI (C4 to C6). Recruitment took place at the University Hospital of Tübingen, the Charité-Universitätsmedizin Berlin, and the Neurological Rehabilitation Clinic Beelitz-Heilstätten (Germany). Participants were selected based on the following inclusion criteria: Age between 18 and 85 years, interval after SCI at least 6 months, lesion height C4–C6, ASIA grade A–C. Exclusion criteria were the following: Consumption of illegal drugs or more than two alcoholic beverages per day, history of severe neurological injuries or conditions other than SCI (e.g., multiple sclerosis, stroke and cerebral palsy), severe medical conditions (e.g., renal/liver/heart failure; malignant tumor disease), serious cognitive impairment and severe spasticity.

All 14 participants took part in the baseline test of the BeBiTT (without intervention). For further validation using an exoskeleton, ten participants (all male, mean age 44.7 ± 14.6 years) with complete (n = 5; ASIA grade A) and incomplete (n = 5; ASIA grades B to D) cSCI (C5 to C6) repeated the BeBiTT using a B/NHE (intervention). All participants were BCI naïve, i.e., they had never taken part in any BCI training or application. Four participants had to be excluded from the intervention due to incapability to wear the hand exoskeleton, arthritic pain, impending hand surgery and skepticism about brain-controlled technology.

Study procedure

The study protocol complied with the Declaration of Helsinki. Ethical approval was obtained from the Ethical Committee of the Medical Faculty of the University of Tübingen (201/2018BO1). After providing written informed consent, participants were comfortably seated in front of a desk for the BeBiTT baseline assessment. The BeBiTT tasks were explained, and their proper execution was demonstrated by the instructor. The participant was encouraged to perform the tasks as close to the instructor’s demonstration as possible. The participant was reminded of the importance to use both hands and to avoid compensatory strategies if possible. There was no time limit to perform the tasks. The participant could also repeat each task to reach a higher score. After completing the BeBiTT without assistance (baseline), the B/NHE was attached to the participants’ hand and fingers. Then, the BeBiTT was repeated in the exact same manner as in the baseline condition (intervention). The whole session was videotaped, and videos were stored for later review. At the end of the session, all participants were interviewed on the self-care category of Spinal Cord Independence Measure III (SCIM III) and Quadriplegia Index of Function (QIF) and completed a questionnaire assessing safety and feasibility of the BeBiTT.

Hybrid brain/neural hand exoskeleton (B/NHE)

For the intervention, a wearable hand exoskeleton with nine motor units (HandyRehab from Zunosaki Ltd., Hong Kong) was donned to the participant’s left or right hand, depending on the participant’s choice. Control of the exoskeleton was established by a hybrid BCI, translating EEG and EOG signals into open and close commands. Sensorimotor rhythm event-related desynchronization (SMR-ERD) associated with intended grasping motions was detected by EEG and translated into exoskeleton closing motions. Horizontal oculoversions (HOV) detected by EOG were used to control exoskeleton opening motions or to stop unintended closing [13]. EEG was recorded with a Smarting Mobi system (mBrainTrain, Serbia) and a semi-dry saline-based cap (Greentek Pty. Ltd, Wuhan, China) from 5 conventional recording sites according to the international 10/20 system (C3, Cz, F3, P3, T3 for right hand exoskeleton control, or C4, Cz, F4, P4, T4 for left exoskeleton control). A surface Laplacian filter was applied to reduce signal-to-noise ratio of the target electrodes C3 or C4. Signals were recorded at a sampling frequency of 250 Hz and filtered between 0.1 and 70 Hz with a Butterworth filter. For EOG, two additional electrodes were placed on the right and left outer canthus. The signal amplitude was converted into a bipolar signal and low pass filtered at 1.5 Hz. EEG and EOG signals were processed and classified by a customized version of the BCI2000 software platform (www.bci2000.org) [24].

Internal consistency, interrater-reliability, construct validity, and sensitivity to change

For assessing internal consistency of the BeBiTT’s test items, Cronbach’s alpha and corrected item-total correlation was calculated using SPSS (v.27) for baseline scores. As suggested by Kline [25], corrected item-total correlation was set below 0.30 for items to be discarded. For assessing interrater reliability, the scorings of the study instructor and three independent raters were obtained. The independent raters were blinded to the participants’ diagnosis and ASIA classification. Raters were given the scoring sheet (Additional file 1) along with a short explanation of the scoring system. They were asked to fill out the scoring sheets for each participant individually and not to discuss the video clips or the assigned scores with each other. Agreement in scores between raters was tested by calculating the intraclass correlation coefficient (ICC) using SPSS (v.27) for both the baseline and intervention. The ICC was calculated based on an absolute-agreement, 2-way mixed-effects model.

To assess construct validity of the BeBiTT, two common ADL tests were assessed by interview: the self-care category of the Spinal Cord Independence Measure III (SCIM III) and the Quadriplegia Index of Function-Short Form (QIF-SF) [21, 26]. While the self-care category of SCIM III and QIF-SF do not assess hand function exclusively, they include many tasks that require bimanual function and are thus suitable to assess construct validity of the BeBiTT baseline scores [27]. The construct validity of the BeBiTT was assessed by computing Pearson’s correlation coefficient between BeBiTT baseline scores and the SCIM III self-care category as well as the QIF-SF.

To assess sensitivity to change between baseline and intervention, a non-parametric bootstrapped paired t-test with 1000 permutations was applied using SPSS. Effect size (Cohen’s D) was calculated. Furthermore, BeBiTT subscores (grasping, lifting, manipulating components) were tested for significance using a bootstrapped paired t-test with 1000 permutations.

Results

Participants rated all BeBiTT tasks as feasible and safe. No adverse events or discomforts were reported. In the internal consistency analysis of BeBiTT baseline scores, Cronbach’s alpha reached α = 0.91. All tasks of the BeBiTT positively correlated with the overall score and exceeded the predefined threshold of r > 0.30 (Table 3). For the baseline, raters’ agreement in single values showed an ICC of 0.959 with a 95% confidence interval (CI) from 0.811 to 0.985, F(13,39) = 101.5, and raters’ agreement in mean values showed an ICC of 0.989 with a 95% CI [0.976; 0.996], F(13,39) = 101.5. For the intervention, raters’ agreement in single values showed an ICC of 0.950 with a 95% CI from 0.858 to 0.986, F(9,27) = 116.5 and raters’ agreement in mean values showed an ICC of 0.987 with a 95% CI [0.960; 0.997], F(9,27) = 116.5. Results were significant across all conditions (p < 0.001). If removed, the two items ‘pour glass of water’ and ‘apply toothpaste on toothbrush’ would increase alpha by 0.009 and 0.01 respectively (Table 3). To assess construct validity of the BeBiTT, Pearson’s correlation was calculated between the BeBiTT baseline scores (M = 45.7, SD = 20.8) of all participants and scores in SCIM III self-care category (M = 11.6, SD = 6.00) as well as QIF-SF scores (M = 16.0, SD = 6.62). There was a strong correlation between BeBiTT baseline scores and SCIM self-care category scores, r(14) = 0.77, p < 0.001 (Fig. 2). Also, BeBiTT baseline scores and QIF-SF scores were positively correlated, r(14) = 0.66, p = 0.011 (Fig. 3).

Table 3 Internal consistency analysis
Fig. 2
figure 2

Correlation between of the Berlin Bimanual Test for Tetraplegia (BeBiTT) scores (n = 14) and Spinal Cord Independence Measure III (SCIM III) self-care scores without intervention. BeBiTT scores showed a high correlation with the SCIM III scores (r = 0.77, p < 0.01) evidencing high construct validity

Fig. 3
figure 3

Correlation between the Berlin Bimanual Test for Tetraplegia (BeBiTT) scores (n = 14) and Quadriplegia Index of Function – Short Form (QIF-SF) scores without intervention. BeBiTT scores showed a high correlation with the QIF-SF scores (r = 0.66, p < 0.01) evidencing high construct validity

On average, participants improved significantly in BeBiTT score when using the B/NHE system (M = 59.8, SD = 17.4) compared to baseline (M = 48.2, SD = 17.7), p = 0.029 (Fig. 4). The bootstrapped (N = 1,000) difference in means was tested for normality and homogeneity of variance and found to be normally distributed (skewness = − 0.38, SE = 0.023; kurtosis = 0.08, SE = 0.047). Bootstrap 95% CI estimate for difference in means did not include zero [6.1;16.4]. The effect size for this analysis (d = 1.063) was found to exceed Cohen’s (1988) convention for a large effect (d = 0.8). Across participants, all components of bimanual function (grasping, manipulating, lifting) improved when using the B/NHE system compared to baseline (Table 4). In lifting, the average score improved by more than 50% from 5.8 (SD = 4.3) to 8.8 points (SD = 4.2), p < 0.05. Significant improvement was also shown in grasping from baseline (M = 19.8, SD = 4.8) to intervention (M = 27.3, SD = 5.4), p < 0.001. Mean score in manipulating did not improve significantly from 22.6 (SD = 9.9) to 23.6 points (SD = 8.5; p = 0.59). On average, all BeBiTT tasks were scored higher with help of the B/NHE system compared to baseline (Table 5). Participants with baseline scores below 40 points showed largest improvement, increasing initial BeBiTT scores by 43.5 to 78.6% when using the B/NHE (Table 6).

Fig. 4
figure 4

Difference in Berlin Bimanual Test for Tetraplegia (BeBiTT) scores without (baseline) and with use of a B/NHE system (intervention). Centerlines show the medians. Box limits indicate the 25th and 75th percentiles. Upper and lower whiskers illustrate maximum and minimum, respectively. B/NHE application resulted in a marked increase of the BeBiTT score (*p < 0.05) in average across participants (n = 10)

Table 4 BeBiTT scores for components of bimanual function across conditions
Table 5 Improvement in BeBiTT score across all items using an assistive hand exoskeleton
Table 6 BeBiTT scores for components of bimanual function across conditions and participants

Discussion

We have introduced the BeBiTT as a broadly accessible test to evaluate bimanual task performance after cSCI and have validated it across 14 tetraplegic individuals. Our results show that the BeBiTT is a feasible, reliable, and valid tool to assess bimanual task performance in tetraplegia. Cronbach’s alpha (0.91) exceeded the threshold for clinical instruments (> 0.9) defined by Nunnally [28], and documented excellent internal consistency. Only two items (Pour glass of water and Apply toothpaste on toothbrush) would slightly increase alpha if deleted. Although this would marginally increase the internal consistency of the BeBiTT, we decided not to discard the two items given the already excellent alpha score of 0.91 with all items included and the already small number of items. Scores of each item positively correlated with the total score (r > 0.30), further underlining the internal consistency of the test. Interrater reliability, calculated according to Koo and Li [29], was excellent (ICC > 0.9) for both baseline and intervention, indicating that the BeBiTT can reliably assess bimanual task performance with or without the use of assistive tools such brain-controlled exoskeletons. Support of the BeBiTT’s construct validity was provided by a strong positive correlation between baseline scores of the BeBiTT and the SCIM III self-care category as well as the QIF-SF.

Besides validating the BeBiTT’s feasibility, reliability, and validity, we demonstrate its sensitivity to assess improvement in bimanual task performance related to assistive tools, such as a B/NHE. While individuals with tetraplegia usually perform the (passive) tenodesis grasp that does not provide a strong grip necessary for ADLs, assistive hand exoskeleton control allowed for active movements and sufficient grip strength in bimanual tasks, resulting in increased scores in grasping. Moreover, the hand exoskeleton improved lifting scores across all participants as it provided a secure and firm grip that did not lose stability and strength, enabling participants to securely perform bimanual tasks in a lifted position (Fig. 5). Only in manipulation, no significant improvement was achieved. This could be due to the limited capacity of the applied exoskeleton to perform various grasp types, or limited routine of the users with handling such assistive device. While some participants had difficulty performing fine manipulations with the exoskeleton due to its unwieldiness, others were able to handle the exoskeleton better which resulted in improved manipulation. This observation is supported by the large interindividual variability in manipulation scores as expressed in a high standard deviation. Overall, the performance of the BeBiTT improved with B/NHE use across all participants.

Fig. 5
figure 5

Participant during baseline (left) and while using a brain/neural hand exoskeleton (B/NHE, right) for the BeBiTT item ‘Pour glass of water’. Without the B/NHE, the participant was unable to securely hold the bottle, so that he had to press the bottle against his torso to stabilize it (left). The B/NHE enabled the participant to firmly grasp and lift the water bottle, allowing him to complete the task without difficulties (right). Control of the B/NHE was established by a hybrid BCI, translating electroencephalographic (EEG) and electrooculographic (EOG) signals into hand opening and closing movements

Participants with a baseline BeBiTT score below 40 showed to benefit the most from such intervention. High effect size further exemplified the BeBiTT’s ability to detect enhancement in bimanual function through assistive hand exoskeleton use. By presenting the BeBiTT’s sensitivity to change, we demonstrate the impact of B/NHEs on bimanual task performance in a systematic and replicable way.

While the BeBiTT was originally designed to assess the impact of neurotechnology-based assistive devices, it can also be applied to evaluate alternative approaches that aim at restoring hand function after SCI, e.g., assessing the effect of tendon transfer or functional electric stimulation (FES) on bimanual function in individuals with tetraplegia. The BeBiTT does not only allow to monitor individual therapeutic success but also facilitates the comparison between different training approaches in occupational therapy and physiotherapy. In addition to its use in individuals with tetraplegia, the BeBiTT can be used as a template for assessing bimanual function in other patient groups, such as stroke survivors [12, 13, 30, 31], although adjustments may need to be made according to the population’s level of impairment. The BeBiTT might be also a useful tool to evaluate recovery of bimanual task performance secondary to neuroplasticity, e.g., triggered by repeated use of assistive exoskeletons [10, 32]. Generally, we believe that bimanual function should be given more attention in upper limb rehabilitation, considering the relevance of bimanual tasks in daily life. By providing a reliable and accessible tool for the assessment of bimanual function, we hope to facilitate future research into this direction.

While some ADL categories such as eating and drinking are well represented in the BeBiTT, other categories are only represented by one item to reduce the time of administration and practicality. Representation of these less represented ADL categories could be improved by including more items but would also substantially increase the time of test administration. While psychometric evaluation of the BeBiTT showed excellent results, the reported findings must be further validated across larger clinical studies to foster its broad clinical acceptance. In addition, it is unclear whether the reported improvements in bimanual task performance using brain-controlled exoskeletons generalize to larger clinical populations. Although the present study involved the highest number of study participants in which a BCI-driven hand exoskeleton was used to assess bimanual task performance in tetraplegia to our knowledge (n = 10), more data is necessary to account for demographic factors such as time since injury, ASIA classification and lesion height. In the present study, there was also no control for confounding variables such as sequence effects or fatigue. Previous studies showed that fatigue and lack of concentration can affect BCI performance [33]. Since the baseline was assessed first, this could have caused learning effects, positively influencing the outcome of the intervention. In contrast, fatigue might have affected the outcome into the opposite direction. Moreover, the participant’s capability for BCI control was not directly assessed (e.g., by determining false-positive or false-negative control commands), but indirectly through functional improvement in the BeBiTT. Poor exoskeleton control could explain why one participant performed worse in the intervention compared to baseline. Here, it is conceivable that more routine with handling assistive hand exoskeletons would improve manipulation abilities as measured by the BeBITT. In the present work, B/NHE control was only applied to one hand. Future studies should investigate how bimanual task performance is affected when users wear bilateral B/NHE as introduced by Nann et al. [34], providing more information of the BeBiTT's responsiveness to neurotechnology-based interventions.

Conclusion

This study shows that the BeBiTT is a reliable and valid test to assess bimanual task performance in tetraplegia, e.g., to evaluate the impact of a brain-controlled hand exoskeleton. Availability of the BeBiTT closes an important gap in the clinical evaluation of upper limb motor function after SCI that, so far, did not sufficiently addressed bimanual task performance and compatibility of the test with the use of assistive tools. Assessing the BeBiTT takes less than 20 min and can easily be incorporated in any clinical and research environment.

Availability of data and materials

The videotapes of participants analyzed in the current study are available from the corresponding author on reasonable request. All other data generated or analyzed during this study are included in this published article.

References

  1. Anderson KD. Targeting recovery: priorities of the spinal cord-injured population. J Neurotrauma. 2004;21(10):1371–83. https://doi.org/10.1089/neu.2004.21.1371.

    Article  Google Scholar 

  2. Lo C, Tran Y, Anderson K, Craig A, Middleton J. Functional priorities in persons with spinal cord injury: using discrete choice experiments to determine preferences. J Neurotrauma. 2016;33(21):1958–68.

    Article  Google Scholar 

  3. Bunketorp-Käll L, Wangdell J, Reinholdt C, Fridén J. Satisfaction with upper limb reconstructive surgery in individuals with tetraplegia: the development and reliability of a Swedish self-reported satisfaction questionnaire. Spinal Cord. 2017;55(7):664–71.

    Article  Google Scholar 

  4. Dunn JA, Sinnott KA, Rothwell AG, Mohammed KD, Simcock JW. Tendon transfer surgery for people with tetraplegia: an overview. Arch Phys Med Rehabil. 2016;97(6):S75–80.

    Article  Google Scholar 

  5. Benabid AL, Costecalde T, Eliseyev A, Charvet G, Verney A, Karakas S, Foerster M, Lambert A, Morinière B, Abroug N. An exoskeleton controlled by an epidural wireless brain–machine interface in a tetraplegic patient: a proof-of-concept demonstration. Lancet Neurol. 2019;18(12):1112–22.

    Article  Google Scholar 

  6. Collinger JL, Wodlinger B, Downey JE, Wang W, Tyler-Kabara EC, Weber DJ, McMorland AJ, Velliste M, Boninger ML, Schwartz AB. High-performance neuroprosthetic control by an individual with tetraplegia. Lancet. 2013;381(9866):557–64. https://doi.org/10.1016/S0140-6736(12)61816-9.

    Article  Google Scholar 

  7. Hochberg LR, Bacher D, Jarosiewicz B, Masse NY, Simeral JD, Vogel J, Haddadin S, Liu J, Cash SS, Van Der Smagt P. Reach and grasp by people with tetraplegia using a neurally controlled robotic arm. Nature. 2012;485(7398):372–5.

    Article  CAS  Google Scholar 

  8. Soekadar SR, Witkowski M, Gómez C, Opisso E, Medina J, Cortese M, Cempini M, Carrozza MC, Cohen LG, Birbaumer N, Vitiello N. Hybrid EEG/EOG-based brain/neural hand exoskeleton restores fully independent daily living activities after quadriplegia. Sci Robot. 2016;1(1):eaag3296. https://doi.org/10.1126/scirobotics.aag3296.

    Article  Google Scholar 

  9. Witkowski M, Cortese M, Cempini M, Mellinger J, Vitiello N, Soekadar SR. Enhancing brain–machine interface (BMI) control of a hand exoskeleton using electrooculography (EOG). J Neuroeng Rehabil. 2014;11(1):165. https://doi.org/10.1186/1743-0003-11-165.

    Article  Google Scholar 

  10. Cervera MA, Soekadar SR, Ushiba J, Millán JDR, Liu M, Birbaumer N, Garipelli G. Brain–computer interfaces for post-stroke motor rehabilitation: a meta-analysis. Ann Clin Transl Neurol. 2018;5(5):651–63. https://doi.org/10.1002/acn3.544.

    Article  Google Scholar 

  11. Donati AR, Shokur S, Morya E, Campos DS, Moioli RC, Gitti CM, Augusto PB, Tripodi S, Pires CG, Pereira GA, Brasil FL, Gallo S, Lin AA, Takigami AK, Aratanha MA, Joshi S, Bleuler H, Cheng G, Rudolph A, Nicolelis MA. Long-term training with a brain–machine interface-based gait protocol induces partial neurological recovery in paraplegic patients. Sci Rep. 2016;6:30383. https://doi.org/10.1038/srep30383.

    Article  CAS  Google Scholar 

  12. Soekadar SR, Birbaumer N, Slutzky MW, Cohen LG. Brain–machine interfaces in neurorehabilitation of stroke. Neurobiol Dis. 2015;83:172–9. https://doi.org/10.1016/j.nbd.2014.11.025.

    Article  Google Scholar 

  13. Soekadar SR, Witkowski M, Vitiello N, Birbaumer N. An EEG/EOG-based hybrid brain-neural computer interaction (BNCI) system to control an exoskeleton for the paralyzed hand. Biomed Tech (Berl). 2015;60(3):199–205. https://doi.org/10.1515/bmt-2014-0126.

    Article  Google Scholar 

  14. Cappello L, Meyer JT, Galloway KC, Peisner JD, Granberry R, Wagner DA, Engelhardt S, Paganoni S, Walsh CJ. Assisting hand function after spinal cord injury with a fabric-based soft robotic glove. J Neuroeng Rehabil. 2018;15(1):59–59. https://doi.org/10.1186/s12984-018-0391-x.

    Article  Google Scholar 

  15. Osuagwu BA, Timms S, Peachment R, Dowie S, Thrussell H, Cross S, Shirley R, Segura-Fragoso A, Taylor J. Home-based rehabilitation using a soft robotic hand glove device leads to improvement in hand function in people with chronic spinal cord injury: a pilot study. J Neuroeng Rehabil. 2020;17(1):1–15.

    Article  Google Scholar 

  16. Yoo H-J, Lee S, Kim J, Park C, Lee B. Development of 3D-printed myoelectric hand orthosis for patients with spinal cord injury. J Neuroeng Rehabil. 2019;16(1):162.

    Article  Google Scholar 

  17. Franz EA. Bimanual action representation: a window to human evolution. Taking action: cognitive neuroscience perspectives on intentional acts. 2003;259–288.

  18. Kapadia N, Zivanovic V, Verrier M, Popovic MR. Toronto rehabilitation institute-hand function test: assessment of gross motor function in individuals with spinal cord injury. Top Spinal Cord Inj Rehabil. 2012;18(2):167–86. https://doi.org/10.1310/sci1802-167.

    Article  Google Scholar 

  19. Marino RJ, Patrick M, Albright W, Leiby BE, Mulcahey M, Schmidt-Read M, Kern SB. Development of an objective test of upper-limb function in tetraplegia: the capabilities of upper extremity test. Am J Phys Med Rehabil. 2012;91(6):478–86.

    Article  Google Scholar 

  20. Wuolle KS, Van Doren CL, Thrope GB, Keith MW, Peckham PH. Development of a quantitative hand grasp and release test for patients with tetraplegia using a hand neuroprosthesis. J Hand Surg. 1994;19(2):209–18.

    Article  CAS  Google Scholar 

  21. Catz A, Itzkovich M, Agranov E, Ring H, Tamir A. SCIM—spinal cord independence measure: a new disability scale for patients with spinal cord lesions. Spinal Cord. 1997;35(12):850–6. https://doi.org/10.1038/sj.sc.3100504.

    Article  CAS  Google Scholar 

  22. Barreca S, Gowland C, Stratford P, Huijbregts M, Griffiths J, Torresin W, Dunkley M, Miller P, Masters L. Development of the chedoke arm and hand activity inventory: theoretical constructs, item generation, and selection. Top Stroke Rehabil. 2004;11(4):31–42.

    Article  Google Scholar 

  23. Kantak S, Jax S, Wittenberg G. Bimanual coordination: a missing piece of arm rehabilitation after stroke. Restor Neurol Neurosci. 2017;35(4):347–64. https://doi.org/10.3233/RNN-170737.

    Article  Google Scholar 

  24. Schalk G, McFarland DJ, Hinterberger T, Birbaumer N, Wolpaw JR. BCI2000: a general-purpose brain–computer interface (BCI) system. IEEE Trans Biomed Eng. 2004;51(6):1034–43. https://doi.org/10.1109/TBME.2004.827072.

    Article  Google Scholar 

  25. Kline P. A handbook of test construction (psychology revivals): introduction to psychometric design. Milton Park: Routledge; 2015.

    Book  Google Scholar 

  26. Marino R, Goin J. Development of a short-form Quadriplegia Index of Function scale. Spinal Cord. 1999;37(4):289–96.

    Article  CAS  Google Scholar 

  27. Rudhe C, van Hedel HJ. Upper extremity function in persons with tetraplegia: relationships between strength, capacity, and the spinal cord independence measure. Neurorehabil Neural Repair. 2009;23(5):413–21.

    Article  Google Scholar 

  28. Nunnally JC. Psychometric theory (2nd edn.). New York; 1978.

  29. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63.

    Article  Google Scholar 

  30. Angerhöfer C, Colucci A, Vermehren M, Hömberg V, Soekadar SR. Post-stroke rehabilitation of severe upper limb paresis in Germany—towards long-term treatment with personalized neurotechnology. Front Neurol. 2021;2166.

  31. Colucci A, Vermehren M, Cavallo A, Angerhofer C, Peekhaus N, Zollo L, Kim WS, Paik NJ, Soekadar SR. Brain–computer interface-controlled exoskeletons in clinical neurorehabilitation: ready or not? Neurorehabil Neural Repair. 2022;36(12):747–56. https://doi.org/10.1177/15459683221138751.

    Article  Google Scholar 

  32. Ramos-Murguialday A, Broetz D, Rea M, Laer L, Yilmaz O, Brasil FL, Liberati G, Curado MR, Garcia-Cossio E, Vyziotis A, Cho W, Agostini M, Soares E, Soekadar S, Caria A, Cohen LG, Birbaumer N. Brain–machine interface in chronic stroke rehabilitation: a controlled study. Ann Neurol. 2013;74(1):100–8. https://doi.org/10.1002/ana.23879.

    Article  Google Scholar 

  33. Myrden A, Chau T. Effects of user mental state on EEG-BCI performance. Front Hum Neurosci. 2015;9:308. https://doi.org/10.3389/fnhum.2015.00308.

    Article  Google Scholar 

  34. Nann M, Peekhaus N, Angerhöfer C, Soekadar SR. Feasibility and safety of bilateral hybrid EEG/EOG brain/neural–machine interaction. Front Hum Neurosci. 2020. https://doi.org/10.3389/fnhum.2020.580105.

    Article  Google Scholar 

Download references

Acknowledgements

We thank all study participants for their valuable contributions to this study. We also thank David Haslacher for his valuable advice and suggestions regarding the data analysis.

Funding

Open Access funding enabled and organized by Projekt DEAL. This research is supported in part by the European Research Council (ERC) under the project NGBMI (759370), the Federal Ministry of Research and Education (BMBF) under the projects SSMART (01DR21025A) and NEO (01DR21025A), the Korean Ministry of Science and ICT under the framework of the German-Korean Academia-Industry International Collaboration Program on Robotics and Lightweight Construction/Carbon (Grant No. P0017226), and the Einstein Stiftung Berlin.

Author information

Authors and Affiliations

Authors

Contributions

CA, MV, MN and AC and SRS conceptualized the study. AN and PK helped with recruitment of participants. CA, MV, MN and AC conducted the study and collected the data. CA wrote the first version of the manuscript. CA, MV, MN, AC, PK, AN, WSK, WKC, NJP, VH and SRS provided critical feedback and revised the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Surjo R. Soekadar.

Ethics declarations

Ethics approval and consent to participate

Ethical approval was obtained from the Ethical Committee of the Medical Faculty of the University of Tübingen (201/2018BO1).

Consent for publication

All participants gave their written consent.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

BebiTT Scoring Sheet.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Angerhöfer, C., Vermehren, M., Colucci, A. et al. The Berlin Bimanual Test for Tetraplegia (BeBiTT): development, psychometric properties, and sensitivity to change in assistive hand exoskeleton application. J NeuroEngineering Rehabil 20, 17 (2023). https://doi.org/10.1186/s12984-023-01137-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12984-023-01137-4

Keywords