Comparison of neuromuscular and cardiovascular exercise intensity and enjoyment between standard of care, off-the-shelf and custom active video games for promotion of physical activity of persons post-stroke
Journal of NeuroEngineering and Rehabilitation volume 18, Article number: 63 (2021)
Active video games have been embraced for the rehabilitation of mobility and promotion of physical activity for persons post-stroke. This study seeks to compare carefully matched standard of care stepping activities, off-the-shelf (non-custom) active video games and custom active video games that are either self-paced or game-paced for promoting neuromuscular intensity and accuracy, cardiovascular intensity, enjoyment and perceived effort.
Fifteen persons (ages 38–72) with mild to moderate severity in the chronic phase post-stroke (average 8 years) participated in a single group counter balanced repeated measures study. Participants were included if they were greater than 6 months post-stroke, who could walk 100 feet without assistance and stand unsupported for three continuous minutes. They were excluded if they had cardiac, musculoskeletal or neurologic conditions that could interfere with repeated stepping and follow instructions. In a single session located in a laboratory setting, participants executed for 8.5 min each: repeated stepping, the Kinect-light race game, two custom stepping games for the Kinect, one was repeated and self-paced and the other was random and game paced. Custom video games were adjusted to the participants stepping volume. Ten-minute rest periods followed the exercise during which time participants rested and completed the PACES an enjoyment questionnaire. Participants were instrumented with a metabolic cart and heart rate sensor for collection of cardiovascular intensity (METs and % of max HR) data. Stepping frequency, accuracy and pattern were acquired via video. Data were analyzed using a RMANOVA and post-hoc comparison with a Holm's/Sidak correction.
Neuromuscular intensity (repetitions) was significantly greater for the off-the-shelf and self-paced custom game, however accuracy was greater for the custom games. Cardiovascular intensity for all activities took place in the moderate intensity exercise band. Enjoyment (measured with a questionnaire and rankings) was greater for the custom active video games and rate of perceived exertion was lower for the custom active video games.
Custom active video games provided comparable intensity but better accuracy, greater enjoyment and less perceived exertion than standard of care stepping activities and a carefully matched off-the-shelf (non-custom) video game. There were no differences between the game-paced and self-paced custom active video games.
Trial registration: NCT04538326.
Activity and participation are often limited for persons-post stroke. Mobility problems are reported by 58% of people in chronic stage after stroke, fatigue in 52%, and falls in 44% . Low cardiorespiratory fitness and other impairments, such as decreased balance and muscle strength interact to drive post-stroke activity limitations and participation restriction . People post-stroke may only manage to walk short distances, walk slowly, fatigue more often during everyday activities and are at greater risk for falls. Their sedentary lifestyle is related not only to decreased walking ability, but it also increases risk for another stroke and other cardio-vascular diseases, depression, psychosocial disfunctions and decreased quality of life . Physical exercise programmes may serve to increase physical fitness and mobility of people post-stroke [2, 4].
Active video games (AVGs) became available for movement focused rehabilitation when gaming consoles such as the Play Station II (PS2) with the Eye Toy camera, the Nintendo Wii and the Microsoft Xbox with the Kinect camera were trialed by clinicians and tested by researchers [5,6,7]. Analyses of the non-custom AVGs associated with the consoles identified elements of motor learning and therapeutic exercise in order to guide the application of AVGs into physical therapy practice, as well as rehabilitation research [8,9,10,11]. Recent surveys of virtual reality and AVGs confirm that AVGs have become part of the repertoire of rehabilitation tools used for persons post-stroke. Physical and occupational therapists, surveyed about virtual reality and video games in both in Canada and the United States, report primarily using non-custom AVGs for commercial consoles such as the Nintendo Wii and the Microsoft Kinect to treat balance and fitness for persons post-stroke.  Boyne and colleagues  reported AVGs were used to promote aerobic exercise for persons post-stroke in a variety of clinical settings. AVGs appear to meet the need for rehabilitation of mobility and fitness deficits experienced by persons post-stroke.
Evidence to support these non-custom AVGs has been increasing with their potential application for rehabilitation of upper limb use,  balance and mobility  as well as promotion of physical activity (PA) [16, 17] for persons post-stroke. There has also been an interest in developing active custom games for upper limb use  and balance [19,20,21]. A rationale often proposed for incorporating AVGs into stroke rehabilitation is their potential to increase participant motivation. Several elements of AVGs may account for increasing or be associated with motivation; these include game mechanics (such as scoring), performance feedback, “the right level of challenge” and enjoyment . In persons post-stroke in an inpatient setting who played upper limb games using a manipulandum to control a game displayed on a tv, the use of feedback was shown to be superior in improving movement speed and smoothness to games that did not provide performance feedback. Importantly, they also had greater motivation (measured with the interest and enjoyment subscale of the Intrinsic Motivation Inventory) with the game play . Game mechanics that involved scoring and “operant conditioning” both yielded higher performance metrics when playing an upper limb labyrinth game with those features .
Enjoyment is proposed as an important construct to recommend AVG play . It has been measured by the same group of investigators while persons post-stroke: (1) interacted with the PS2 Eye Toy,  (2) compared enjoyment while playing the PS2 and the Wii  and (3) played Kinect Sports and Adventure games . Across all three studies, enjoyment was reported by persons post-stroke. Enjoyment was also identified as an important construct linking engagement for motor learning in virtual environments . It is speculated that enjoyment is a factor that also promotes motivation and may lead to sustained and intense activity required for neural, musculoskeletal and cardiovascular plasticity required for stroke rehabilitation. In fact, several groups have shown that persons post-stroke exercising in virtual environments and AVGs achieve high levels of repetitions  and a higher number of repetitions (a measure of intensity) compared to standard therapy .
While the non-custom AVGs have shown promise and they are appealing because of their low-cost, high quality graphics and variety, they have several important limitations for incorporating them into therapy. Often, they are not user-centered, do not meet therapeutic goals, nor provide performance metrics, nor promote desirable movement patterns [30, 31]. One of the consistent limitations, of these off-the-shelf consoles and their games, reported by both clinicians and persons post-stroke, is the lack of control in adjusting exercise parameters such as speed or difficulty . The lack of game control is especially true for game-paced, rather than player or self-paced games. AVGs and virtual environments may also not reliably promote optimal movement patterns [33,34,35]. This is particularly important for persons post-stroke who exhibit asymmetrical movements. The promise that some of these limitations could be addressed with games that were specifically designed for rehabilitation was heralded with the open development kit of the Kinect (STK). The combination of markerless motion capture with customized software could overcome some of the limitations of non-custom off-the shelf games as well the cost of more specialized systems. Several groups have developed custom games with the Kinect primarily for balance that allow customization and clinician control and have been shown to efficacious in rehabilitation post stroke  or superior to off -the-shelf analogs in older adults . There are however, to our knowledge no studies that carefully compare movement performance, energetics and enjoyment of off-the-shelf video games with custom games as well as standard of care activities for persons with stroke.
Therefore, in this study we sought to compare if carefully matched standard of care activities and off-the-shelf AVG with customized AVGs produced a desirable exercise intensity and player experience for persons post-stroke. The specific purpose of this study was to determine if: (1) Movement outcomes of neuromuscular intensity (repetitions) and movement accuracy were superior when playing an off-the-shelf AVG, compared to custom AVGs or standard of care therapy, (2) Cardiovascular intensity outcomes of (METs and % of HRmax) were superior when playing an off-the-shelf AVGs, compared to custom AVGs or standard of care therapy, (3) enjoyment, game preference and perceived effort differed when playing an off-the-shelf AVG, compared to custom AVGs or standard of care therapy and (4) there was a difference in neuromuscular and cardiovascular intensity as well as enjoyment and game preference between the two customized AVGs that are self-paced compared to game-paced. We hypothesized that neuromuscular and cardiovascular intensity, would differ between custom AVGs, off-the shelf AVGs and standard of care; and that enjoyment would be greater and perceived effort lower for the custom AVGs compared to the off-the-shelf AVG and standard of care.
This study was a single group repeated measures mixed methods design approved by the Rutgers Institutional Review board. Data were acquired in a single session with all study activities listed in Fig. 1. A sample of convenience was recruited within the community of Newark, NJ and surrounding areas through flyers and word of mouth. Participants of previously completed studies conducted by this laboratory were also informed of this study opportunity.
Individuals in the chronic phase post-stroke were eligible to participate if they walked 100 feet without assistance and could stand unsupported for three continuous minutes. Individuals were excluded if they had a history of any of the following: (1) severe heart disease, (2) heart attack, (3) valve replacement or coronary artery bypass surgery, (4) severe lung disease, (5) uncontrolled diabetes, (6) traumatic brain injury or neurological disorder other than stroke, (7) an unstable medical condition or musculoskeletal disorder such as arthritis or hip and knee surgery, or (8) any other condition that would interfere with repeated stepping. Interested individuals engaged in a phone screen and completed the Activity Readiness Questionnaire (PAR-Q),  receiving clearance from their primary care physicians when applicable.
After consenting, demographic data including PA and video game history were collected at the start of the session. Participants were familiarized with the four exercise conditions which were divided into two blocks, a game-paced block and a self-paced block. Familiarization included physical practice and reporting exertion with the Borg Rating of Perceived Exertion Scale (RPE) [38, 39]. Participants were allowed to use their assistive devices during familiarization and data collection and were guarded as appropriate for safety. While participants practiced the custom game, the VSTEP, in both the repeated and random conditions, the volume of stepping for each game was calibrated independently for the affected and unaffected lower extremities. Calibration of the custom game was completed and understanding of game play for each condition was confirmed before data collection commenced. Between the two activity blocks, participants were tested for their motor control using the lower extremity section of the Fugl Meyer Assessment Scale (scored between 0 and 34 points). .
Participants were instrumented with a heart rate monitor (Polar HC-10, Finland) and a mask for the portable metabolic cart unit (Cosmed KB4) to obtain physiological data. Resting physiological data were obtained while participants were comfortably seated in a dimly lit environment during ten-minute rest periods preceding the performance of each condition. Then, during each condition physiological data were continuously obtained. Event markers were recorded on the metabolic unit to bookend each rest period and each study condition to aid in data extraction. The RPE was recorded at mid-point and end of each condition. A study team member held up a clipboard with the numbers 6–20 and their respective perceived exertion levels (rest—maximum exertion) written in bold print [38, 39]. Participants pointed to or verbally indicated their RPE score when asked.
The four exercise conditions, as illustrated in Fig. 1, were selected to compare an off-the-shelf video game, a custom video game (in two modes), and a standard of care condition. They were performed for 8.5 min with bouts of stepping gameplay interleaved with 30-s bouts of marching. The duration of the conditions was selected for participants to reach an exercise plateau, in order to extract and analyze metabolic data and derive METs . The four conditions were selected to be equivalent. For the self-paced block, the movements were identical in duration and movement direction. For the game-paced block, the pattern of stepping was restricted to the forward, lateral and diagonal directions, not allowing for backward stepping. Participants were instructed to “keep moving” for the entire 8.5 min in all conditions. The off-the-shelf game only allowed for 1.5 min of gameplay in one bout and required 30 s to restart the game. The marching bouts were added to address this constraint of the off-the-shelf game and the other conditions were designed to include marching activities to ensure equivalence of the conditions. The visual display of all three video games was rendered with a short throw projector with a size of 5 ft high by 4 ft wide. The standard of care activity did not have a visual display. For a comparison of characteristics of the four study conditions see, Table 1. Each condition is described as follows:
Kinect Light Race (Kinect-LR): Participants played the off-the-shelf X-Box Kinect game Light Race at “easy” difficulty. For this game, there was a full body avatar and circle of four tiles (1) right side, (2) right front, (3) left front, and 4) left side. The size of the circle and the position of the tiles was the same for all participants. Participants were instructed to step on the tiles when they changed color. Participants were instructed to march between game play bouts.
VSTEP Random (VRAN): Participants played the custom VSTEP game in the random mode. The VSTEP was originally developed and validated by the authors . The current version was developed using UNITY 3d game engine (Unity Technologies, Denmark) and C# programing language and uses the Kinect 1 sensor (Microsoft Corp, United States) for skeletal tracking of the lower extremities. For this game, there were avatar shoes representing the lower extremities, a center square and 6 tiles (1) right side, (2) right diagonal, (3) right front, (4) left front, (5) left diagonal, (6) left side. In the random mode participants were directed to step on blue tiles with their left foot and red tiles with their right foot. The speed and location of the tiles was directed by the game. In between each stepping bout participants were directed to lift their feet in a march-like step to contact an onscreen ball.
VSTEP Repeated (VREP): Used the VSTEP with the same onscreen display, as VSTEP Random, with the avatar shoes, the center square, and onscreen tiles. In this condition, however, participants played the VSTEP in the repeated mode followed a specific sequence of stepping and marching in place for 30-s until a new direction was stated. Visual feedback and coinciding auditory feedback were provided as participants observed their foot avatar from a first person view and the target and center tiles alternated changing color at the pace set by the participant’s stepping. Each lower extremity had its own color. The stepping sequence was left side step, right side step, left forward step, march, right diagonal step, left diagonal step, right forward step, march, left side step, rights side step, left forward step, right diagonal step, march, right forward step, left side step, right side step, and march. This condition included the same march-like gameplay activity with the onscreen ball as described above.
Standard of Care (SOC): The identical set of movements in the same sequence as the VREP condition were performed for the SOC condition, but without any visual targets or feedback.
Participants completed the Physical Activity Enjoyment Scale (PACES) immediately after each activity, for a total of four times. The PACES is an 18-item scale that assesses enjoyment for PA by asking patients to rate how they feel at the time of PA on a 7-point Likert scale, from 1 (I enjoy it) to 7 (I hate it). Scores range between 18 and 126, with higher scores indicating higher enjoyment [42, 43]. After completing all four conditions, participants ranked ordered their preferences based on what they liked best. They also ranked each condition based on difficulty from easiest to hardest and answered open-ended questions about their experiences of each condition. Open ended questions were posed as follows: “can tell us what you experienced and why you selected item X as the one you liked the most” and “Is there anything that you would like to tell us that we did not ask?” Participants were encouraged to elaborate on their responses and the tester paraphrased the response to get confirmation that it was understood clearly.
Data extraction and reduction
Neuromuscular intensity and performance: repetitions and accuracy
Each study condition was video recorded with an iPAD from behind the participant in order to capture both the display screen and the participant. During the three video game conditions, the lights in the room were turned off so that the display screen was clearly visible. A reflective marker was placed on the heel of each shoe at the ankle height just prior to game play and a lamp with light directed at the participants feet was used to facilitate visibility of the reflective marker used for step counting in the video recording.
Stepping and marching repetitions were extracted from the videos for all conditions. Two assessors (one had acquired the videos, the other verified the counts) manually counted the steps. A protocol for acceptable counts was developed and validated. Inter-rater reliability was established. Step repetitions were determined by the number of steps completed for each 30-s period defined by limb and direction of step. For example, if the participant was instructed to step with their right foot forward for 30 s, the number of steps with that extremity in that direction for 30 s was the frequency. The total number of steps over each 8.5-min bout was also considered when extracting and analyzing frequency.
Accuracy of the VREP, VRAN, and Kinect-LR stepping was extracted from the videos. Two assessors manually counted the accurate steps. A step was considered accurate if the participant’s foot landed partially or fully within the target tile. Similarly, when recorded by the system, a step was considered accurate if the participant stepped into the correct tile as required by the game. The foot was considered “on target” when half of the foot had entered the target tile. Within the game, this is ensured using object colliders both on the foot (placed around the arch of the foot) and the tile (around the boundaries). Only counts from the video data were included in the analysis. The SOC did not have an accuracy requirement.
Cardiovascular intensity: heart rate and metabolic equivalents
Raw data from the Cosmed system were exported as a Microsoft Excel file. In Excel, the data were visually inspected to verify the markers for the start and end time of each bout. Any erroneous markers were removed, and the bouts were labeled. In Matlab (MathWorks, United States), a three-minute plateau was selected and filtered using a Butterworth bandpass (30–200 Hz) filter. The plateau was defined as stable data extracted 240 s from the end of the exercise condition. The volume of oxygen consumption (VO2), percent of maximum heart rate (%HRmax:: % (220-age)) and metabolic equivalent (METS = (VO2/Kg)/ 3.5) were calculated using standard formulas .
Perceived exertion, enjoyment, and activity preference rankings
Perceived exertion measured with the RPE scores for the mid-point and end of each condition were tallied. Enjoyment data were scored with the PACES. The eleven negatively worded items were reversed and summed with the scores for the positively worded items, resulting in a total score. Enjoyment was also was also analyzed with five-item version mPACES that focuses on game play . The test scored items 1, 3, 6, 10 and 12 for a total of 35 points. They were expressed as a percent. The preference rankings were tallied. Open ended questions were reviewed for themes that explain the numerical data.
The mean values (steps and march repetition, %HRmax and METs), maximum METs, and steps accuracy were calculated for each subject and then used for analysis on the group level. Box plots were drawn to display variation in samples (whiskers denote range, box denotes interquartile range, center line denotes median). Data were assessed for equal variance using the Mauchly sphericity test. Where the sphericity could not be assumed the Greenhouse–Geisser correction was used. Repeated measures ANOVA and post hoc paired t-tests with Holm's/Sidak correction for the number (2 or 3) of comparisons were calculated to test for differences in repetitions and accuracy (total steps, steps of the affected and unaffected lower extremities, total march repetitions, step accuracy of each limb), heart rate and metabolic equivalent (%HRmax, METs), and perceived exertion and enjoyment (RPE scores, PACES and mPACES scores expressed as a %, ranking preference) between the study conditions. Level of significance was set on value alpha ≤ 0.05 with corrections for comparison as noted above. For the measures of perceived exertion and enjoyment, minimal clinically important difference (MCID) was estimated with the distribution method by taking half of the baseline SD of the score  in each study condition. In analyzing differences between the pairs, the highest MCID value calculated for each pair was used as the MCID limit value for the results interpretation. Microsoft Excel 2010 (Microsoft Corp., Redmond, WA, USA, 2010) and IBM SPSS Statistics 26 (IBM Corp., Armonk, NY, USA, 2019) were used to calculate descriptive statistics, perform statistical tests and produce graphs.
The study included 15 participants. Their age ranged from 38 to 72 years. The mean time post-stroke was 8 years. They presented with mild to moderate severity on the lower extremity section of the Fugl-Meyer Assessment Scale (FMAS) [40, 46, 47]. The characteristics of the participants are summarized in Table 2. One subject did not complete all four conditions of the study. Therefore, his data were excluded from the statistical analysis; data of 14 subjects were analyzed (n = 14).
Neuromuscular intensity and accuracy
Neuromuscular intensity measured by number of repetitions differed significantly between the four study conditions for total steps repetitions (F(3) = 13.252; p < 0.001) and for march repetitions (F(3) = 4.669; p = 0.009). The post hoc analyses showed significant differences between VREP and VRAN. For VREP, the number of total steps repetition was higher (t(10) = 8.748; p < 0.001), but march repetition was lower (t(10) = − 3.358; p = 0.011) (see Fig. 2a and b). Total step repetitions were significantly higher for Kinect-LR than VRAN (t(10) = 6.700; p < 0.001). The difference in march repetition between these two conditions was not statistically significant.
The same pattern of differences was found also with analysis of the steps repetition by limb. The repetitions of the affected (F(3) = 11.500; p < 0.001) and the unaffected (F(3) = 9.029; p < 0.001) lower extremities differed significantly between the four study conditions. The post hoc analyses showed significantly higher number of steps repetitions for VREP than VRAN for both the affected (t(10) = 4.345; p = 0.001) and the unaffected (t(10) = 4.992; p = 0.001) lower extremities. Also, the steps repetition of each limb was significantly higher for Kinect-LR than VRAN (affected: t(10) = 6.013; p < 0.001 and unaffected: t(10) = 5.895; p < 0.001). There was no significant difference between SOC and VREP for any of the repetition parameters.
Steps accuracy of the affected (F(1.03) = 10.614; p = 0.011) and the unaffected (F(1.03) = 17.680; p = 0.003) lower extremities differed significantly between the three virtual reality conditions. The post hoc analyses showed significantly better steps accuracy for VRAN than Kinect-LR for both the affected (t(8) = − 3.418; p = 0.009) and the unaffected (t(8) = − 4.577; p = 0.002) lower extremities. There was no statistically significant difference in steps accuracy between VREP and VRAN, although the mean values were the highest for VREP (Fig. 3).
Cardiovascular intensity: heart rate and metabolic equivalent
Exercise intensity was measured by HRmax and energy expenditure (METs). There was no significant difference in mean %HRmax between the four study conditions. During all the conditions, exercise intensity was in the band recommended for aerobic exercise for people post stroke (Fig. 4).
The mean METs (F(3) = 9.710; p < 0.001) and the maximum METs (F(3) = 5.354; p = 0.004) differed significantly between the four study conditions. The post hoc analyses showed significantly greater values of both parameters for Kinect-LR than VRAN (mean METs: t(10) = 3.803; p = 0.005 and max METs: t(10) = 2.763; p = 0.030) and no significant difference between VREP and VRAN, and SOC and VREP. During all the conditions, the mean values of both METs parameters were in the band considered moderate exercise (Fig. 5).
Perception of exertion and enjoyment
The RPE score differed significantly between the four study conditions (Table 3). The post hoc analyses showed significantly greater RPE score for SOC than VREP and for Kinect-LR than VRAN. There was no significant difference between VREP and VRAN.
Similarly, participants’ ranking of game preference was significantly different. They liked the SOC condition the least, which was significantly lower than VREP, and they liked Kinect significantly less than VRAN (Table 3). Enjoyment measured by the full PACES scale was on the borderline statistically significant (p = 0.01). Exploratory post hoc analysis showed significantly greater enjoyment for VRAN than the Kinect only (Table 3). In contrast the short version of the PACES showed a significant difference between conditions with the VRAN preferred over the Kinect-LR and VREP.
Cardiovascular intensity based on METs and HR was comparable for all conditions. While there were statistically significant differences favoring the off-the-shelf Kinect-LR game for the METs, all conditions were in the band associated with moderate exercise intensity which meet the recommended guidelines for promotion of PA for persons post-stroke . In contrast, movement intensity based on step repetitions was found to be greater for Kinect-LR stepping gameplay and both the marching and stepping gameplay for the custom self-paced VREP game. Therefore, it appears that similar neuromuscular intensity (repetitions) was achieved by either a custom AVG or the off-the-shelf AVG. Importantly, the intensity of the off-the-shelf Kinect-LR game was achieved at the expense of movement accuracy when compared to both custom AVGs. This speed accuracy trade-off may be important if movement accuracy as well as kinematics are a consideration when including AVGs in rehabilitation of persons post-stroke.
AVGs have an advantage over SOC as they use visual feedback facilitating an external focus of attention and can visually represent knowledge of performance (KP) and knowledge of results (KR). According to the OPTIMAL theory, these attributes can contribute to enhanced motor performance and motivation . Persons post-stroke have demonstrated that they can use visual feedback KP from force generated through the lower extremities to reduce LE asymmetry and improve walking , as well as increase the paretic ground reaction force of the stroke affected lower extremity , and from electromyography selectively recruit lower extremity muscles during cycling task . Combining visual KP and KR is easily achieved with virtual reality and has been shown across studies to improve balance for persons post-stroke in the both the subacute  and chronic phase [14, 54]. The off-the-shelf AVGs can provide the external focus of attention and KR for motivation, but they lack the specificity of movement tracking and therefore cannot offer KP or promote sound kinematics. Previously we reported that kinematics of stepping differed for the VREP compared to SOC. Specifically showing that the lack of visual feedback (SOC) resulted in a reduced step height for the affected lower extremity producing a march height asymmetry. Further, side stepping was also asymmetrical for the SOC and not for the VREP . The cardiovascular intensity findings combined with movement accuracy findings recommend the custom games over both the standard of care activities and off-the shelf AVGs for persons post-stroke.
Consistent with our hypothesis, enjoyment was greater and perceived rate of exertion was lower for the custom AVGs. Specifically, the game-paced random (VRAN) game was rated as most enjoyable with the questionnaire (PACES) and confirmed with the preference rankings. Similarly, perceived exertion was lowest for the game-paced random (VRAN) game. Enjoyment using the PACES was previously reported for a customized game for upper limb rehabilitation post-stroke . The magnitude of their score (65.8) is considerably smaller than that reported here. Enjoyment of AVGs played by persons post-stroke using the PS2 and Wii consoles [5, 29] and in particular the Kinect video games (both game-paced sports and the self-paced 20,000 leaks) has also been previously reported.  Persons post-stroke who used video games in community-based program reported that they experienced video games as a motivation tool rather than treatment . We extend the findings reported by others about video game enjoyment by to comparing enjoyment and perceived effort between custom AVGs, standard of care and off-the-shelf AVGs.
Comparison between the customized games that were either self-paced (VREP) or game-paced (VRAN) yielded interesting results. Neuromuscular intensity was found to be greater for the VREP for steps but the opposite for marches. We speculate that the lower complexity of the VREP where movements are predictable and repeated made it easier to have more steps. The marching difference may be explained by conservation of energy, whereby the VRAN condition was less fatiguing during stepping (with lower repetitions) and was able to exert more effort during the marches. Cardiovascular intensity was comparable between the two custom game conditions. Ratings of the custom games for enjoyment and perceived effort were comparable. This finding was surprising as we anticipated that the random game would be preferred because of the variety. A possible explanation for this unexpected finding is that regardless of game mode participants prefer games that are within their physical abilities. This was possible by customizing the stepping volume for each participant. This is consistent of what persons post-stroke report they want in AVGs . It is also in line with recommended principles of active video game design that suggest games are to be client-centered [31, 57]. Further, enjoyment is an important consideration for training outcomes and has been shown (also measured with the PACES) to be positively related to improved upper extremity performance in persons post-stroke . The custom game preference was validated with both statistical significance and clinically important differences.
The most interesting finding of this study is that benefits of customization appear to be game mode neutral. Customization of games offers several advantages. Among them is the ability to address multiple therapeutic goals with the same game. The fact that there is no difference in enjoyment or perceived effort and both custom games (either self or game paced) were played in the moderate exercise band  suggests that either of the custom games could be used to promote PA. Enjoyment is a positive emotion linked to intrinsic motivation  and is both a predictor and an outcome of PA participation [59, 60]. It is an individual’s perception related to competence and personal preference, which can be associated with the type of PA, intensity level, environmental conditions, competition, and whether the activity takes place in an individual or group format . Due to importance of PA for adults, enjoyment is an important construct for understanding PA participation, so the anticipated physical and psychological benefits can be realized. It may be possible to incorporate the AVGs designed for the VSTEP both for PA promotion as well as addressing balance and mobility goals in therapy.
Selecting AVGs for practice has several considerations including, customization, engagement and promotion of therapeutic goals. Lohse and colleagues  proposed six key factors to evaluate video games: reward, the right difficulty/challenge balance, performance feedback, choice and interactivity, clear goals and mechanics as well as socialization. In this study we focused on the balance of difficulty and challenge, performance feedback as well as clear goals and mechanics. By customizing the volume of stepping, we were able to balance the difficulty/challenge that in turn allowed for positive feedback on performance while not sacrificing intensity. Ultimately, achieving the exercise intensity that has been shown to be important for cardiovascular, neuromuscular and neural plasticity , while preserving movement control, as well aligning with patient’s preferences, may recommend custom games as reliable tool for both the promotion of PA and movement re-education.
Findings of the study should be interpreted with some caution as they are based on a small sample. The findings are reported based on playing the games during only a single session. The participants had mild-moderate lower extremity deficits but were able to do repeated stepping using their assistive device and brace, but did not require external support. Further while some of the findings are statistically significant not all of them are clinically meaningful. Neuromuscular intensity counted with stepping repetitions does not have reference values to interpret their clinical meaning. For enjoyment, perceived effort and ranking preference, a statistical method was used to interpret clinical meaning as there was also no benchmark for a reference. The explicit link between enjoyment and motivation was not measured and remains an important area of study .
Custom AVGs that were either self or game paced were shown to promote comparable neuromuscular (repetitions) and cardiovascular (HR max and METs) intensity to carefully matched off-the-shelf AVGs and standard of care activities while resulting in more accurate movements. They were also reported to be more enjoyable and perceived to be less effortful. The custom games provided similar outcomes regardless of whether they were played in a self-paced or game paced mode. These findings add to the body of knowledge about the value of customization in game design for rehabilitation of persons with mild to moderate lower extremity deficits post-stroke.
Availability of data and materials
McKevitt C, Fudge N, Redfern J, Sheldenkar A, Crichton S, Rudd AR, et al. Self-reported long-term needs after stroke. Stroke. 2011;42(5):1398–403.
Saunders DH, Greig CA, Mead GE. Physical activity and exercise after stroke: review of multiple meaningful benefits. Stroke. 2014;45(12):3742–7.
Vahlberg B, Cederholm T, Lindmark B, Zetterberg L, Hellstrom K. Factors related to performance-based mobility and self-reported physical activity in individuals 1–3 years after stroke: a cross-sectional cohort study. J Stroke Cerebrovasc Dis. 2013;22(8):e426–34.
Saunders DH, Sanderson M, Hayes S, Johnson L, Kramer S, Carter DD, et al. Physical fitness training for stroke patients. Cochrane Database Syst Rev. 2020;3:CCD003316.
Rand D, Kizony R, Weiss PT. The Sony PlayStation II EyeToy: low-cost virtual reality for use in rehabilitation. J Neurol Phys Ther. 2008;32(4):155–63.
Flynn S, Palma P, Bender A. Feasibility of using the Sony PlayStation 2 gaming platform for an individual poststroke: a case report. J Neurol Phys Ther. 2007;31(4):180–9.
Deutsch JE, Borbely M, Filler J, Huhn K, Guarrera-Bowlby P. Use of a low-cost, commercially available gaming console (Wii) for rehabilitation of an adolescent with cerebral palsy. Phys Ther. 2008;88(10):1196–207.
Deutsch JE, Brettler A, Smith C, Welsh J, John R, Guarrera-Bowlby P, et al. Nintendo wii sports and wii fit game analysis, validation, and application to stroke rehabilitation. Top Stroke Rehabil. 2011;18(6):701–19.
Levac D, Espy D, Fox E, Pradhan S, Deutsch JE. “Kinect-ing” with clinicians: a knowledge translation resource to support decision making about video game use in rehabilitation. Phys Ther. 2015;95(3):426–40.
Levac DE, Pradhan S, Espy D, Fox E, Deutsch JE. Usability of the “kinect-ing” with clinicians website: a knowledge translation resource supporting decisions about active videogame use in rehabilitation. Games Health J. 2018;7:362–8.
Givon Schaham N, Zeilig G, Weingarden H, Rand D. Game analysis and clinical use of the Xbox-Kinect for stroke rehabilitation. Int J Rehabil Res . 2018;41(4):323–30.
Levac D, Glegg S, Colquhoun H, Miller P, Noubary F. Virtual reality and active videogame-based practice, learning needs, and preferences: a cross-canada survey of physical therapists and occupational therapists. Games Health J. 2017;6(4):217–28.
Boyne P, Billinger S, MacKay-Lyons M, Barney B, Khoury J, Dunning K. Aerobic exercise prescription in stroke rehabilitation: a web-based survey of US physical therapists. J Neurol Phys Ther. 2017;41(2):119–28.
Laver KE, Lange B, George S, Deutsch JE, Saposnik G, Crotty M. Virtual reality for stroke rehabilitation. Cochrane Database Syst Rev. 2017;11:CD008349.
Iruthayarajah J, McIntyre A, Cotoi A, Macaluso S, Teasell R. The use of virtual reality for balance among individuals with chronic stroke: a systematic review and meta-analysis. Top Stroke Rehabil. 2017;24(1):68–79.
Hurkmans HL, Ribbers GM, Streur-Kranenburg MF, Stam HJ, van den Berg-Emons RJ. Energy expenditure in chronic stroke patients playing Wii Sports: a pilot study. J Neuroeng Rehabil. 2011;8:38.
Kafri M, Myslinski MJ, Gade VK, Deutsch JE. Energy expenditure and exercise intensity of interactive video gaming in individuals poststroke. Neurorehabil Neural Repair. 2014;28(1):56–65.
Cameirao MS, Smailagic A, Miao G, Siewiorek DP. Coaching or gaming? Implications of strategy choice for home based stroke rehabilitation. J Neuroeng Rehabil. 2016;13:18.
Llorens R, Alcaniz M, Colomer C, Navarro MD. Balance recovery through virtual stepping exercises using Kinect skeleton tracking: a follow-up study with chronic stroke patients. Stud Health Technol Inf. 2012;181:108–12.
Llorens R, Gil-Gomez JA, Alcaniz M, Colomer C, Noe E. Improvement in balance using a virtual reality-based stepping exercise: a randomized controlled trial involving individuals with chronic stroke. Clin Rehabil. 2015;29(3):261–8.
Llorens R, Noe E, Colomer C, Alcaniz M. Effectiveness, usability, and cost-benefit of a virtual reality-based telerehabilitation program for balance recovery after stroke: a randomized controlled trial. Arch Phys Med Rehabil. 2015;96(3):418-25 e2.
Bermúdez i Badia S, Fluet G, Llorens R, Deutsch JE. Virtual reality for sensorimotor rehabilitation post stroke: design principles and evidence. In: Reinkensmeyer D, Dietz V, editors. Neurorehabilitation technology. Cham: Springer; 2016.
Popovic MD, Kostic MD, Rodic SZ, Konstantinovic LM. Feedback-mediated upper extremities exercise: increasing patient motivation in poststroke rehabilitation. Biomed Res Int. 2014;2014:520374.
Shah N, Basteris A, Amirabdollahian F. Design parameters in multimodal games for rehabilitation. Games Health J. 2014;3(1):13–20.
Graves LE, Ridgers ND, Williams K, Stratton G, Atkinson G, Cable NT. The physiological cost and enjoyment of Wii Fit in adolescents, young adults, and older adults. J Phys Act Health. 2010;7(3):393–401.
Neil A, Ens S, Pelletier R, Jarus T, Rand D. Sony PlayStation EyeToy elicits higher levels of movement than the Nintendo Wii: implications for stroke rehabilitation. Eur J Phys Rehabil Med. 2013;49(1):13–21.
Rohrbach N, Chicklis E, Levac DE. What is the impact of user affect on motor learning in virtual environments after stroke? A scoping review. J Neuroeng Rehabil. 2019;16(1):79.
Deutsch JE, Merians AS, Adamovich S, Poizner H, Burdea GC. Development and application of virtual reality technology to improve hand use and gait of individuals post-stroke. Restor Neurol Neurosci. 2004;22(3–5):371–86.
Rand D, Givon N, Weingarden H, Nota A, Zeilig G. Eliciting upper extremity purposeful movements using video games: a comparison with traditional therapy for stroke rehabilitation. Neurorehabil Neural Repair. 2014;28(8):733–9.
Levac DE, Galvin J. Facilitating clinical decision-making about the use of virtual reality within paediatric motor rehabilitation: application of a classification framework. Dev Neurorehabil. 2011;14(3):177–84.
Wiemeyer J, Deutsch J, Malone LA, Rowland JL, Swartz MC, Xiong J, et al. Recommendations for the optimal design of exergame interventions for persons with disabilities: challenges, best practices, and future research. Games Health J. 2015;4(1):58–62.
Hung YX, Huang PC, Chen KT, Chu WC. What do stroke patients look for in game-based rehabilitation: a survey study. Medicine (Baltimore). 2016;95(11):e3032.
Knaut LA, Subramanian SK, McFadyen BJ, Bourbonnais D, Levin MF. Kinematics of pointing movements made in a virtual versus a physical 3-dimensional environment in healthy and stroke subjects. Arch Phys Med Rehabil. 2009;90(5):793–802.
Liebermann DG, Berman S, Weiss PL, Levin MF. Kinematics of reaching movements in a 2-D virtual environment in adults with and without stroke. IEEE Trans Neural Syst Rehabil Eng. 2012;20(6):778–87.
James-Palmer A, Puh U, Damodaran H, Kim E, Bowlby P, Deutsch JE, editors. Playing self-paced video game requires the same energy expenditure but is more enjoyable and effortful than standard of care activities. International Conference on Virtual Reality; July 2019; Tel Aviv, Israel.
Willaert J, De Vries AW, Tavernier J, Van Dieen JH, Jonkers I, Verschueren S. Does a novel exergame challenge balance and activate muscles more than existing off-the-shelf exergames? J Neuroeng Rehabil. 2020;17(1):6.
Thomas S, Reading J, Shephard R. Revision of the physical activity readiness questionnaire (PAR-Q). Can J Sports Sci. 1992;14(4):338–45.
Borg G. The Borg RPE Scale in Borg's perceived xertion and pain scales: Human Kinetics; 1998. pp. 29–38.
Borg GA. Psychophysical bases of perceived exertion. Med Sci Sports Exerc. 1982;14(5):377–81.
Fugl-Meyer AR. Post-stroke hemiplegia assessment of physical properties. Scand J Rehabil Med Suppl. 1980;7:85–93.
Gosine R, Damodaran H, Deutsch JE, editors. Formative evaluation and preliminary validation of kinect open source stepping game. International conference on virtual rehabilitation (ICVR); 2015; Valencia, Spain: IEEE.
Kendzierski D, DeCarlo K. Physical activity enjoyment scale: two validation studies. J Sport Exerc Psychol. 1991;13:50–64.
Murrock CJ, Bekhet A, Zauszniewski JA. Psychometric evaluation of the physical activity enjoyment scale in adults with functional limitations. Issues Mental Health Nurs. 2016;37(3):164–71.
Jette M, Sidney K, Blumchen G. Metabolic equivalents (METS) in exercise testing, exercise prescription, and evaluation of functional capacity. Clin Cardiol. 1990;13(8):555–65.
Norman GR, Sloan JA, Wyrwich KW. Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care. 2003;41(5):582–92.
Fugl-Meyer AR, Jaasko L, Leyman I, Olsson S, Steglind S. The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. Scand J Rehabil Med. 1975;7(1):13–31.
Duncan PW, Propst M, Nelson SG. Reliability of the Fugl-Meyer assessment of sensorimotor recovery following cerebrovascular accident. Phys Ther. 1983;63(10):1606–10.
Billinger SA, Arena R, Bernhardt J, Eng JJ, Franklin BA, Johnson CM, et al. Physical activity and exercise recommendations for stroke survivors: a statement for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2014;45(8):2532–53.
Wulf G, Lewthwaite R. Optimizing performance through intrinsic motivation and attention for learning: the OPTIMAL theory of motor learning. Psychon Bull Rev. 2016;23(5):1382–414.
Sackley CM, Lincoln NB. Single blind randomized controlled trial of visual feedback after stroke: effects on stance symmetry and function. Disabil Rehabil. 1997;19(12):536–46.
Genthe K, Schenck C, Eicholtz S, Zajac-Cox L, Wolf S, Kesar TM. Effects of real-time gait biofeedback on paretic propulsion and gait biomechanics in individuals post-stroke. Top Stroke Rehabil. 2018;25(3):186–93.
Mullens CH, Brown DA. Visual feedback during pedaling allows individuals poststroke to alter inappropriately prolonged paretic vastus medialis activity. J Neurophysiol. 2018;119(6):2334–46.
Yom C, Cho HY, Lee B. Effects of virtual reality-based ankle exercise on the dynamic balance, muscle tone, and gait of stroke patients. J Phys Ther Sci. 2015;27(3):845–9.
Kim JH, Jang SH, Kim CS, Jung JH, You JH. Use of virtual reality to enhance balance and ambulation in chronic stroke: a double-blind, randomized controlled study. Am J Phys Med Rehabil. 2009;88(9):693–701.
Putrino D, Zanders H, Hamilton T, Rykman A, Lee P, Edwards DJ. Patient engagement is related to impairment reduction during digital game-based therapy in stroke. Games Health J. 2017;6(5):295–302.
Rand D, Givon N, Avrech BM. A video-game group intervention: experiences and perceptions of adults with chronic stroke and their therapists: intervention de groupe à l’aide de jeux vidéo : expériences et perceptions d’adultes en phase chronique d’un accident vasculaire cérébral et de leurs ergothérapeutes. Can J Occup Therapy. 2018;85(2):158–68.
Munoz JE, Goncalves A, Rubio Gouveia E, Cameirao MS, Bermudez IBS. Lessons learned from gamifying functional fitness training through human-centered design methods in older adults. Games Health J. 2019;8(6):387–406.
Wankel LM. The importance of enjoyment to adherence and psychological benefits from physical-activity. Int J Sport Psychol. 1993;24(2):151–69.
Williams DM, Papandonatos GD, Napolitano MA, Lewis BA, Whiteley JA, Marcus BH. Perceived enjoyment moderates the efficacy of an individually tailored physical activity intervention. J Sport Exerc Psychol. 2006;28(3):300–9.
Dacey M, Baltzell A, Zaichkowsky L. Older adults’ intrinsic and extrinsic motivation toward physical activity. Am J Health Behav. 2008;32(6):570–82.
Lohse K, Shirzad N, Verster A, Hodges N, Van der Loos HF. Video games and rehabilitation: using design principles to enhance engagement in physical therapy. J Neurol Phys Ther. 2013;37(4):166–75.
Boyne P, Meyrose C, Westover J, Whitesel D, Hatter K, Reisman DS, et al. Exercise intensity affects acute neurotrophic and neurophysiological responses poststroke. J Appl Physiol (1985). 2019;126(2):431–43.
Swanson LR, Whittinghill DM. Intrinsic or extrinsic? Using Videogames To Motivate Stroke Survivors: A Systematic Review. Games Health J. 2015;4(3):253–8.
We thank Brittany Hoehlien, Essie Kim, Marisa Priolo and Joshua Pacifico for their contributions to data collection and analysis and the conference papers associated with this study. We appreciate Rose Peng and Salma for their contribution to data acquisition and analysis. We thank the participants and their families for their time.
TechAdvance grant from Rutgers University to JED, SHP Rutgers Summer Internship to AJP.
Ethics approval and consent to participate
Obtained from Rutgers University.
Consent for publication
No individual data or images are included in this publication
Dr. Deutsch is a named inventor on the VSTEP which was the system used for the custom games reported in this study.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Deutsch, J.E., James-Palmer, A., Damodaran, H. et al. Comparison of neuromuscular and cardiovascular exercise intensity and enjoyment between standard of care, off-the-shelf and custom active video games for promotion of physical activity of persons post-stroke. J NeuroEngineering Rehabil 18, 63 (2021). https://doi.org/10.1186/s12984-021-00850-2
- Active video games
- Virtual reality