Rehabilitation of hemineglect of the left arm using movement detection bracelets activating a visual and acoustic alarm
Journal of NeuroEngineering and Rehabilitation volume 13, Article number: 79 (2016)
Hemineglect is frequent after right hemisphere stroke and prevents functional independence, but effective rehabilitation interventions are lacking. Our objective was to determine if a visual-acoustic alarm in the hemineglect arm activated by a certain discrepancy in movement of both hands can enhance neglect arm use in five tasks of daily living.
In this pre-post intervention study 9 stroke patients with residual hemineglect of the arm were trained for 7 days in five bimanual tasks of daily living: carrying a tray, button fastening, cutting food with knife and fork, washing the face with both hands and arm sway while walking. This was done through motion sensors mounted in bracelets on both wrists that compared movement between them. When the neglect-hand movement was less than a limit established by two fuzzy logic based classifiers, a visual-acoustic alarm in the neglect-hand bracelet was activated to encourage its use in the task.
Both motion and function of the neglect hand improved during the seven days of training when visual-acoustic alarms were active but a worsening to baseline values occurred on day 8 and day 30 when alarms where switched off. Improvement was limited to vision-dependent tasks.
Neglect-hand improvement with this approach is limited to bimanual activities in which an object is manipulated under vision control, but no short or long term learning happens.
In visual-spatial hemineglect (also known as hemi-inattention) patients with a lesion of the right cerebral hemisphere are not aware of objects in the left visual field despite not having a visual deficit. When it encompasses left limbs, as well as lacking awareness of them, the patient does not use the left arm in spite of not having paralysis. Neglect predicts not regaining functional independence . In more than 85 % of patients with right hemispheric stroke, hemineglect is found in at least one pencil and paper tests such as cancellation of lines and marking lines in their middle point, copy of superimposed shapes or of a figurative drawing. But in 36 % of cases, neglect in activities of daily living cannot be detected by these tests . Among the 28 standardized tests for hemineglect , the Catherine Bergego scale is one of the most used and asks about performance of the patient in activities of daily living but does not measure the performance itself. Several rehabilitation strategies for hemineglect have been used [4, 5] including forced visual sweep scanning, trunk rotation, application of muscle vibration in the neck, mental images, visual prisms, sensory activation of the left arm , vestibular stimulation on the left side, and transcranial magnetic stimulation . Currently, there is insufficient evidence to recommend a particular rehabilitation strategy for neglect as shown by a Cochrane review that found no efficacy of rehabilitation interventions in reducing disability [8, 9]. In this pre-post intervention pilot study, we studied if a visual-acoustic alarm in the hemineglect arm activated by its reduced movement relative to the contralateral arm could increase neglect arm use in five tasks of daily living. To monitor arm movement, we used triaxial accelerometers, previously employed to measure upper limb movement after stroke [10, 11].
Design: This is a pre-post intervention study in a consecutive, convenience sample of hemineglect patients.
Subjects: The study included 9 subjects (4 males and 5 females, aged between 65 and 85 years). All subjects had left hemineglect including the hand except one female that had right hemineglect. They had been consecutively admitted to the Neurology Department of “Hospital Universitario” in Burgos (Spain) for a contralateral stroke (8 of right and 1 of left hemisphere) that had damaged the cerebral cortex six or more months before the beginning of the study. For the sake of simplification, the single patient with a right arm neglect has been and analyzed with all the rest of the patients with left arm neglect. After a complete neurological examination, hemineglect of the arm was defined when there was extinction of tactile and visual simultaneous stimuli and data of neglect in the following tests: cancellation of lines, marking of lines at their middle point and cancellation of stars among distracting figures. Hemineglect was quantified by the Catherine-Bergego scale. Other inclusion criteria were a normal or near normal strength of the hand (4+ on the Medical Research Council scale), and preserved sight and hearing. Exclusion criteria were cognitive or language impairment, anesthesia of the arm in any sensory modality or any physical, psychological o social limitation for participating in the study or for follow-up in the opinion of the investigator. These exclusion criteria or refusal to participate prevented 11 other screened patients from entering the study. This study was approved by the “Hospital Universitario de Burgos” Clinical Trials and Ethics Committee and patients agreed their participation by signing an informed consent prior to their inclusion.
Devices: Motion sensors embedded in light bracelets for both wrists, included in the left a visual (flashing light) and audible (beep) alarm that was triggered and emitted its light and sound when the lack of left arm movement caused a certain asymmetry with the right arm movement. Sensors included a tri-axial capacitive accelerometer made of silicon by microelectronic system technology. It had a sampling frequency of 16 Hz, could store data in its memory during 45 min and when memory was filled, data could be transferred to a computer. The pair of sensors were synchronized using an “ad-hoc” 433 MHz wireless link between them, allowing an almost simultaneous gathering of samples. Data from each sensor was processed using a sliding window of 1 s length and no overlap, computing the Amount of Movement transformation. The mean and the maximum Amounts of Movement was finally determined using a second sliding window of size 10 and no overlap. Two Mamdani Fuzzy Rule Based Classifiers (FRBC) were used in order to determine the degree of dissimilarity among the movement of both hands: one FRBC took as inputs the mean Amount of Movement from both hands, while the other the maximum Amount of Movement. A fuzzy partition was proposed for each input fuzzy variable, with granularity 3 and Gaussian-type fuzzy membership functions. The output of both FRBC was also a fuzzy variable with granularity 3 as well, but with triangle-shaped membership functions. It could range from 0-100, higher values indicating more right-left hand motion dissimilarity. The parameter setting was performed with a genetic algorithm using a vector of real values individual representation, the blend-alpha cross-over operator with alpha set to 0.3 and a mutation operation with probability 0.02. Previous unpublished use of this model made us assign a threshold of dissimilarity of 40 for normal and of 60 for hemineglect subjects, above which the alarm would set off. The hemineglect patients repeated during one hour the five bimanual tasks mentioned below during days 1 to 7 following the instructions of one of the authors: an occupational therapist (R-M, V) with experience in rehabilitation of activities of daily living. Patients were encouraged to use the left arm as much as the right arm in the five bimanual tasks to avoid movement dissimilarity between both hands that would set off the alarm. The intervals analyzed to set off an alarm were of 10 s; the audio-visual alarm stopped when the patient corrected the movement or after 10 s without correction. If there was no correction, it stopped for 3 s and was ready to be triggered again.
Variables: five bimanual tasks of daily living were evaluated with the motion sensors previously described: two intended to be representative of tasks in which both hands are used as a whole (hand sway while walking, simulating washing the face with both hands) and other three of more variable tasks, with need for visual control and for adjustment of movements during the activity (carrying a tray, fastening buttons and cutting food with knife and fork).
The following two efficacy variables measured the performance of the left hemineglect hand using the contralateral right hand as control in each of these tasks. The first variable was a measure of movement dissimilarity between hands, was calculated subtracting the right from the left hand movement data registered by motion sensors, and was named “asymmetry of hand movement”. A decrease in asymmetry indicated a better performance.
The other was a surrogate variable for “functional improvement” and consisted of the number of times that the improvement allowed making the alarm trigger more demandingly while performing the five mentioned tasks from the mentioned initial 60 threshold level. Two points would be reduced the next exercise day when at the end of the actual session the alarm had set off less than half the number of times the previous day, and four points when the alarm had not set off at all.
Data collection: During the measurements, the previously mentioned bimanual five tasks were done in the same order and had the same duration every day. Although sensors registered movement data every day, on certain days visual-acoustic alarms were silenced: on day 0 to register baseline data and on days 8 and 30 to compare captured data with that of day 0. This was done to assess if the exercise of activities during days 1 to 7 based in the active visual and acoustic alarm feedback improved movement persistently in the absence of alarms.
Statistical analysis: All analysis was performed for each of the five above mentioned tasks in days 0, 1, 7, 8 and 30. Description of data was followed by statistical analysis of both efficacy variables “asymmetry of movement” and “functional improvement” variables. Due to the non-normal distribution of all variables and sample size, nonparametric tests were chosen: Wilcoxon rank sign test for repeated measures or the Friedman test depending on whether two or more assessments of the efficacy variable were done, and the Kruskal-Wallis test in case of no repeated assessments of the variables. A 95 % confidence interval or P < 0.05 defined statistical significance. The statistical package for social science (SPSS v. 19) was used.
In each of the five tasks, the number of alarms and trigger modifications allowed by improvements in performance were distributed differently (Kruskal-Wallis, p <0.002), indicating that motor performance in the tasks was heterogeneous, as expected. In all cases the hand suffering hemineglect moved less than the contralateral, healthy hand-according to the definition of hemineglect-, producing an asymmetry in hand motion. This asymmetry decreased during day 1 to 7 in which activities were exercised with alarm feedback, in some cases to the point of reverting (Table 1). The other efficacy variable (“functional improvement”) also ameliorated in all five tasks, which allowed resetting the alarm trigger at least in one of days 2-7 and in three days in the activity of cutting food with knife and fork.
As shown in Table 2, in the five tasks as a whole there was a decrease of right-left hand movement asymmetry from baseline (without visual-acoustic alarm feedback) to both days 1 and 7 (with active visual-acoustic alarms), that is, there was a global improvement of left hand movement on days 1 and 7, associated with visual-acoustic alarm feedback. Analyzing each activity separately, this improvement on both days 1 and 7 was restricted to button fastening, using knife and fork, and carrying a tray but the use of the left hand was not improved for those activities done without visual control (i.e. face washing and left hand sway during walking). In the tasks of carrying a tray, fastening a button and using knife and fork Table 3 also shows global differences among asymmetries of right-left hand movement between all three days (on baseline, on day 1 and on day 7), but no differences are found between the three measurements with visual-acoustic alarms inactive (baseline, day 8 and day 30).
Curves on Fig. 1 show the right-left hand motion asymmetry of the 9 subjects without visual-acoustic alarm feedback [baseline (B), day 8 and day 30] and with visual-acoustic feedback (days 1 to 7 of exercise of activities: E1-E7). In all activities except face washing and arm sway while walking (this last not shown) right to left hand movement asymmetry were reduced on day 1 when alarms were switched on and this held up to day 7 and there was a brisk asymmetry increase on days 8 and 30, when visual-acoustic alarms were again switched off.
The main finding of the study is an improvement of the left hand suffering neglect, both in movement and functionally, during tasks of daily living when analyzed globally and in particular in the following three: fastening buttons, carrying a tray and using fork and knife to eat. But this improvement only happened while the alarm emitted its visual-acoustic signals when triggered by a reduced movement of the left arm suffering neglect relative to the right arm. In this way, there was an improvement from baseline to day 1 and to day 7, of both efficacy variables while visual-acoustic alarms where active but not to day 8 and to day 30, when alarms were disconnected and the patient did not receive those sensorial feedbacks when underperforming with his/her left, neglect arm. It can be deduced that even when hemineglect is formally confirmed in every patient as was the case in this study, it is not complete as visual-acoustic stimuli can still increase motor behavior. Although visual hemineglect is much better known, right hemispheric lesions can also cause auditory neglect of acoustic stimuli within the left hemi-space . If the improving feedback is visual, acoustic or both merits further study but we found the following hint of their relative importance in the two activities that could not receive the visual signal from the alarm. Unlike global findings, in face washing with the hands and arm sway while walking activities, left arm motion did not improve even while receiving the visual-acoustic feedback of the alarm. As these activities are carried out without visual input (eyes closed or not looking at the hands) it is suggested that auditory neglect is profound and prevents the alarm “beep” to enhance left arm motion. The apparently simple gesture of washing the face with both hands, but for which eyes are closed, is the second task triggering more alarms (after fastening buttons, a task with greater difficulty and that is sometimes performed without visual control) which suggest that also in visual hemineglect, when visual stimuli cannot be received motor performance suffers. Conversely, cutting food with knife and fork, the most visually dependent activity, is also the one in which more changes to a more demanding alarm trigger were possible, the surrogate measure of functional improvement that we established. Alternatively, face washing and hand sway activities could have a more “automatic” nature and therefore less dependence from external stimuli.
In inferior parietal lobule lesions, the perceptive component of hemineglect is more marked than in dorso-lateral prefrontal lesions, in which the motor component is more apparent, while deep lesions of the temporal lobe causes object focused hemineglect . It is this last aspect of object focused hemineglect (cutting with knife and fork, fastening buttons, carrying tray), which improved more clearly in this study by the visual-auditory feedback and not purely motor hemineglect like arm swing when walking, or washing face tasks.
Figure 1 shows the neglect arm motion dependence on visual-acoustic alarms: improvement from baseline to day 1 when alarms were switched on (except in face washing and in arm sway while walking, this last not shown), but brisk worsening on day 8 and day 30, when they were switched off. The curves were flat from day 1 to day 7, indicating that the improvement was maintained but did not increase during the seven days of training, suggesting no learning during the training. Indeed, worsening on day 8 and day 30 shows that there was no posterior short term or lasting learning in the absence of visual-acoustic feedback provided by the alarm. This could be due either to insufficient duration of the training or to its inability to generate stimuli-independent neural circuits that can overcome neglect. This absolute dependency on feedback (visual-acoustic in this case) for the performance of motor activities is postulated by the guidance hypothesis of motor learning .
A pre-post intervention design without controls is a limitation that cannot exclude placebo effect, but we deem it unlikely, as some tasks were improved and others not at all by visual-acoustic alarms. Also, bracelets were worn in all evaluations, even when visual-acoustic alarms were disabled. A future study with more patients, with a control group, and using separate visual and acoustic alarms is needed after this preliminary study. There are also significant strengths in the presented data: it does not use neglect tests but tasks of daily living with efficacy variables being objective measures of motion and of function and processed by fuzzy logic, a branch of artificial intelligence appropriate to analyze real-world information, such as human motor activity recognition .
A system of rehabilitation of arm neglect has been evaluated, consisting of a visual-acoustic alarm emitting signals when motion sensors mounted in wrist bracelets detected that the neglect arm lagged behind the right arm in five bimanual tasks of daily living. Data from motion sensors were analyzed using fuzzy logic based models. During the week in which visual-acoustic alarms were active, there was a stable improvement of left hand movement and function. This improvement was limited to tasks that need greater visual control and adjustments (cutting with knife and fork, buttoning and carrying a tray), that is, of hemineglect focused on an object. But there was no improvement in more “automatic” tasks without object manipulation or without the need of visual control (arm sway while walking, washing face). This improvement disappeared as soon as the visual-acoustic alarms were switched-off, suggesting no short nor long term learning.
Fuzzy rule based classifier
Jehkonen M, Laihosalo M, Kettunen JE. Impact of neglect on functional outcome after stroke: a review of methodological issues and recent research findings. Restor Neurol Neurosci. 2006;24(4-6):209–15.
Azouvi P, Samuel C, Louis-Dreyfus A, Bernati T, Bartolomeo P, Beis JM, Chokron S, Leclercq M, Marchal F, Martin Y, De Montety G, Olivier S, Perennou D, Pradat-Diehl P, Prairial C, Rode G, Siéroff E, Wiart L, Rousseaux M. French Collaborative Study Group on Assessment of Unilateral Neglect (GEREN/GRECO). Sensitivity of clinical and behavioural tests of spatial neglect after right hemisphere stroke. J Neurol Neurosurg Psychiatry. 2002;73(2):160–6.
Menon A, Korner-Bitensky N. Evaluating unilateral spatial neglect post stroke: working your way through the maze of assessment choices. Top Stroke Rehabil. 2004;11(3):41–66.
Riggs RV, Andrews K, Roberts P, Gilewski M. Visual deficit interventions in adult stroke and brain injury: a systematic review. Am J Phys Med Rehabil. 2007;86(10):853–60.
Kerkhoff G, Schenk T. Rehabilitation of neglect: an update. Neuropsychologia. 2012;50:1072–9.
Luauté J, Halligan P, Rode G, Rossetti Y, Boisson D. Visuo-spatial neglect: a systematic review of current interventions and their effectiveness. Neurosci Biobehav Rev. 2006;30:961–82.
Marshall RS. Rehabilitation approaches to hemineglect. Neurologist. 2009;15:185–92.
Singh-Curry V, Husain M. Rehabilitation in practice: hemispatial neglect: approaches to rehabilitation [review]. Clin Rehabil. 2010;24:675–84.
Bowen A, Lincoln NB. Cognitive rehabilitation for spatial neglect following stroke. Cochrane Database Syst Rev. 2007;18(2):CD003586.
Rand D, Eng JJ, Tang PF, Jeng JS, Hung C. How active are people with stroke? Use of accelerometers to assess physical activity. Stroke. 2009;40(1):163–8.
Villar JR, González S, Sedano J, Chira C, Trejo-Gabriel-Galan JM. Improving human activity recognition and its application in early stroke diagnosis. Int J Neural Syst. 2015;25(4):1450036. doi:10.1142/S0129065714500361.
Bellmann A, Meuli R, Clarke S. Two types of auditory neglect. Brain. 2001;124(Pt 4):676–87.
Verdon V, Schwartz S, Lovblad KO, Hauert CA, Vuilleumier P. Neuroanatomy of hemispatial neglect and its functional components: a study using voxel-based lesion-symptom mapping. Brain. 2010;133(Pt 3):880–94.
Salmoni AW, Schmidt RA, Walter CB. Knowledge of results and motor learning: a review and critical reappraisal. Psychol Bull. 1984;95(3):355–86.
Iglesias JA, Angelov P, Ledezma A, Sanchis A. Human Activity Recognition Based on Evolving Fuzzy Systems. Int J Neural Syst. 2010;20(5):355–64.
Sara Calvo for statistical assistance, Monica Bártulos and Irene Aicua for help in the design of the database and the search of patients, respectively. This research has been funded by the Gerencia Regional de Salud (Junta de Castilla y León) grant GRS 823/A/13.
This research has been funded by the Gerencia Regional de Salud (Junta de Castilla y León) grant GRS 823/A/13. This public agency has had no role in the design of the study, data collection, analysis and interpretation of the data and in writing the manuscript.
Availability of data and materials
The datasets during and/or analysed during the current study are available from the corresponding author on reasonable request, without breaching participant confidentiality.
TGG conceived of the study, and participated in its design and coordination and helped to draft the manuscript, VRM collected data from patients and helped in the design, SG analyzed data from motion sensors, adjusted them to patients and helped in design, JS and JRV designed the sensors and artificial intelligence algorithms and helped drafting the manuscript, as, NAB that also analyzed captured data. All authors read and approved the final manuscript”.
The authors declare that they have no competing interests.
Ethics approval and consent to participate
This study has obtained approval from the “Hospital Universitario de Burgos Research Ethics Committee”. Among other issues, this requires that an Informed Consent is signed by participants in the study after being informed and before its beginning, to comply with participants’ data protection, notification of unforeseen problems arising from the research and the observance of general ethical rules by all investigators. This study does not include any individual person´s data. Also, this study does not include the use of any animal.
About this article
Cite this article
Trejo-Gabriel-Galan, J.M., Rogel-Melgosa, V., Gonzalez, S. et al. Rehabilitation of hemineglect of the left arm using movement detection bracelets activating a visual and acoustic alarm. J NeuroEngineering Rehabil 13, 79 (2016). https://doi.org/10.1186/s12984-016-0191-0